We cloned the bug as we hit exact same issue on osp14
versions:
python2-novaclient-11.0.0-0.20180809174649.f1005ce.el7ost.noarch
puppet-nova-13.3.2-0.20190426043939.d968cc2.el7ost.noarch
python2-ironicclient-2.5.1-0.20190204170349.931089d.el7ost.noarch
python2-ironic-inspector-client-3.3.0-0.20180810080932.53bf4e8.el7ost.noarch
puppet-ironic-13.3.2-0.20190420083535.5847f5b.el7ost.noarch
On the undercloud we had stopped the controller
(undercloud) [stack@undercloud-0 ~]$ nova stop ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e
Request to stop server ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e has been accepted.
(undercloud) [stack@undercloud-0 ~]$ nova list
---------------+--------------+--------+--------------+-------------+------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+--------+--------------+-------------+------------------------+
| 14147070-f9f9-41bb-bdfc-16fa85debc36 | compute-0 | ACTIVE | - | Running | ctlplane=192.168.24.8 |
| ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e | controller-0 | ACTIVE | powering-off | Running | ctlplane=192.168.24.12 |
+--------------------------------------+--------------+--------+--------------+-------------+------------------------+
(undercloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+---------+------------+-------------+------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+------------+-------------+------------------------+
| 14147070-f9f9-41bb-bdfc-16fa85debc36 | compute-0 | ACTIVE | - | Running | ctlplane=192.168.24.8 |
| ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e | controller-0 | SHUTOFF | - | Running | ctlplane=192.168.24.12 |
+--------------------------------------+--------------+---------+------------+-------------+------------------------+
(undercloud) [stack@undercloud-0 ~]$ openstack baremetal node list
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
| UUID | Name | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
| 8e40ad85-7edc-4ea0-9d86-08ef6ff7f89e | compute-0 | 14147070-f9f9-41bb-bdfc-16fa85debc36 | power on | active | False |
| 04d4cff7-d06f-4352-b3a1-73f65d012a4d | controller-0 | ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e | power off | active | False |
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
We see both Nova and ironic show same status controller is shutdown, expected and Okay.
However when we start that controller up (see bellow)
using virsh we see VM is up and reports status as active, yet power state wrongfully remains shutdown.
(undercloud) [stack@undercloud-0 ~]$ nova start ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e
Request to start server ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e has been accepted.
(undercloud) [stack@undercloud-0 ~]$ openstack baremetal node list
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
| UUID | Name | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
| 8e40ad85-7edc-4ea0-9d86-08ef6ff7f89e | compute-0 | 14147070-f9f9-41bb-bdfc-16fa85debc36 | power on | active | False |
| 04d4cff7-d06f-4352-b3a1-73f65d012a4d | controller-0 | ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e | power off | active | False |
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
(undercloud) [stack@undercloud-0 ~]$ openstack baremetal node list
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
| UUID | Name | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
| 8e40ad85-7edc-4ea0-9d86-08ef6ff7f89e | compute-0 | 14147070-f9f9-41bb-bdfc-16fa85debc36 | power on | active | False |
| 04d4cff7-d06f-4352-b3a1-73f65d012a4d | controller-0 | ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e | power on | active | False |
+--------------------------------------+--------------+--------------------------------------+-------------+--------------------+-------------+
(undercloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+--------+------------+-------------+------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+--------+------------+-------------+------------------------+
| 14147070-f9f9-41bb-bdfc-16fa85debc36 | compute-0 | ACTIVE | - | Running | ctlplane=192.168.24.8 |
| ec89e8ed-ea29-4203-a438-dc4e2fa1fe1e | controller-0 | ACTIVE | - | Shutdown | ctlplane=192.168.24.12 | -> power state should have switched to running, as on virsh console I see prompt/VM is up.
+--------------------------------------+--------------+--------+------------+-------------+------------------------+