Hide Forgot
Description of problem: Can't successfully introspect 7 nodes with RHOSP 10 but don't have those issues with previous RHOSP versions. 2016-12-04 13:13:33.597 18848 ERROR ironic.drivers.modules.ipmitool [-] IPMI power on timed out after 4 retries on node 94793c31-1d69-4a08-b8a7-43eed25aa95e. 2016-12-04 13:13:33.956 18848 ERROR ironic.drivers.modules.ipmitool [-] IPMI power on timed out after 4 retries on node 387b477e-8f3d-486c-a730-0802872c8e4c. 2016-12-04 13:13:34.265 18848 ERROR ironic.drivers.modules.ipmitool [-] IPMI power on timed out after 4 retries on node 026c0cd5-e401-4415-a60b-8634d1b13c48. 2016-12-04 13:13:34.562 18848 ERROR ironic.drivers.modules.ipmitool [-] IPMI power on timed out after 4 retries on node 303055f9-48fb-4c04-bf65-bdfa9581ccb6. Version-Release number of selected component (if applicable): How reproducible: Always Steps to Reproduce: 1. Deploy undercloud 2. Intropsect 7 nodes Actual results: Fails Expected results: Succeeds Additional info: Always fails on 4 nodes after 4 retries each. Perhaps the retries are done too fast and perhaps 4 retry is not enough
Created attachment 1229208 [details] ironic logs
Following the upstream bug ticket: https://bugs.launchpad.net/virtualbmc/+bug/1647229 I've proposed a fix for the VirtualBMC project: https://review.openstack.org/#/c/409755/
Folks, I'm moving this to Ocata, as virtualbmc was not shipped with OSP 10/Newton.
According to our records, this should be resolved by python-virtualbmc-1.0.0-3.el7ost. This build is available now.
This can be marked verified as I no longer see the issue with osp versions 11 or 12 2017-12-06.2[stack@undercloud-0 ~]$ rpm -qa | grep python-virt python-virtualbmc-1.0.0-3.el7ost.noarch [stack@undercloud-0 ~]$ vbmc list +--------------+---------+-------------------+------+ | Domain name | Status | Address | Port | +--------------+---------+-------------------+------+ | ceph-0 | running | ::ffff:172.16.0.2 | 6239 | | ceph-1 | running | ::ffff:172.16.0.2 | 6238 | | ceph-2 | running | ::ffff:172.16.0.2 | 6237 | | compute-0 | running | ::ffff:172.16.0.2 | 6232 | | compute-1 | running | ::ffff:172.16.0.2 | 6236 | | controller-0 | running | ::ffff:172.16.0.2 | 6233 | | controller-1 | running | ::ffff:172.16.0.2 | 6231 | | controller-2 | running | ::ffff:172.16.0.2 | 6230 | | ironic-0 | running | ::ffff:172.16.0.2 | 6235 | | ironic-1 | running | ::ffff:172.16.0.2 | 6234 | +--------------+---------+-------------------+------+