Bug 1339676 - OSP-Director: Fail to register nodes with ironic , openstack-ironic-conductor was not functioning due to missing package python-dracclient.
Summary: OSP-Director: Fail to register nodes with ironic , openstack-ironic-conducto...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: instack-undercloud
Version: 8.0 (Liberty)
Hardware: x86_64
OS: Linux
high
high
Target Milestone: async
: 8.0 (Liberty)
Assignee: Angus Thomas
QA Contact: Alexander Chuzhoy
URL:
Whiteboard:
: 1323800 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-05-25 14:55 UTC by Omri Hochman
Modified: 2022-08-10 10:00 UTC (History)
11 users (show)

Fixed In Version: instack-undercloud-2.2.7-7.el7ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-06-15 12:39:49 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-7719 0 None None None 2022-08-10 10:00:00 UTC
Red Hat Knowledge Base (Solution) 2487891 0 None None None 2016-08-08 13:31:14 UTC
Red Hat Product Errata RHBA-2016:1229 0 normal SHIPPED_LIVE Red Hat OpenStack Platform 8 director Bug Fix Advisory 2016-06-15 16:38:45 UTC

Description Omri Hochman 2016-05-25 14:55:24 UTC
OSP-Director: After upgraded the undercloud from 7.3 to 8.0-poodle,  openstack-ironic-conductor was not functioning due to missing package pyhton-dracclient.


Environment: 
-------------
instack-undercloud-2.2.7-6.el7ost.noarch
openstack-heat-common-5.0.1-6.el7ost.noarch
openstack-heat-api-cloudwatch-5.0.1-6.el7ost.noarch
openstack-tripleo-heat-templates-0.8.14-13.el7ost.noarch
openstack-heat-api-cfn-5.0.1-6.el7ost.noarch
openstack-heat-templates-0-0.8.20150605git.el7ost.noarch
openstack-tripleo-heat-templates-kilo-0.8.14-13.el7ost.noarch
openstack-heat-api-5.0.1-6.el7ost.noarch
heat-cfntools-1.2.8-2.el7.noarch
python-heatclient-1.0.0-1.el7ost.noarch
openstack-heat-engine-5.0.1-6.el7ost.noarch
python-ironicclient-0.8.1-1.el7ost.noarch
openstack-ironic-common-4.2.3-1.el7ost.noarch
openstack-ironic-api-4.2.3-1.el7ost.noarch
python-ironic-inspector-client-1.2.0-6.el7ost.noarch
openstack-ironic-conductor-4.2.3-1.el7ost.noarch
openstack-ironic-inspector-2.2.6-1.el7ost.noarch




Description:
-------------
I was trying to upgrade my 7.3 deployment with SSL to latest 8.0 poodle, after the deployment finish Successfully, I've tried to run some Ironic command to turn off the nodes and it fails :

ironic node-set-power-state 9fdb3940-a4e7-4811-8c4b-9a2b84ded1c9 off
No valid host was found. Reason: No conductor service registered which supports driver pxe_ipmitool. (HTTP 404)

The ironic driver list was empty: 
[stack@undercloud72 ~]$ ironic driver-list
+---------------------+----------------+
| Supported driver(s) | Active host(s) |
+---------------------+----------------+
+---------------------+----------------+
 
Resolution:
After manually install python-dracclient-0.0.5-1.noarch I could restart the ironic-conductor service,  and Ironic returned to function. 


[stack@undercloud72 ~]$ 
[stack@undercloud72 ~]$ ironic node-list
+--------------------------------------+------+--------------------------------------+-------------+--------------------+-------------+
| UUID                                 | Name | Instance UUID                        | Power State | Provisioning State | Maintenance |
+--------------------------------------+------+--------------------------------------+-------------+--------------------+-------------+
| 9fdb3940-a4e7-4811-8c4b-9a2b84ded1c9 | None | bd562860-1c28-40b1-9406-d834ac1fe3e0 | power on    | active             | False       |
| 76420e88-01e7-4e7d-9a05-c64a62925742 | None | 1eb46b1f-96ab-41f1-a11b-84c4f3976667 | power on    | active             | False       |
| 956c7e82-a29f-4b79-b74f-176558fbad8a | None | None                                 | power off   | available          | False       |
| 8f94ce66-f96b-4fcc-aaa0-f1183bba4bc1 | None | 58580eb3-ea7d-4189-9a84-6fabd3765bdc | power on    | active             | False       |
| e47e8d9a-d478-4ba4-a68e-cae8e966b727 | None | 300b267c-b323-47fd-a4cf-5b1089d78dc9 | power on    | active             | False       |
| 4749c38a-cc8f-41f7-b971-18c24c70e169 | None | bc92737f-9c92-4d56-a231-5c4e65743326 | power on    | active             | False       |
| a05b0e84-3281-41a8-aca5-d6abb09b9cfe | None | 54d8833d-4197-421b-bedd-23cc1485bb46 | power on    | active             | False       |
+--------------------------------------+------+--------------------------------------+-------------+--------------------+-------------+
[stack@undercloud72 ~]$ ironic driver-list
+---------------------+----------------+
| Supported driver(s) | Active host(s) |
+---------------------+----------------+
+---------------------+----------------+
[stack@undercloud72 ~]$ 
[stack@undercloud72 ~]$ 
[stack@undercloud72 ~]$ 
[stack@undercloud72 ~]$ ironic node-set-power-state 9fdb3940-a4e7-4811-8c4b-9a2b84ded1c9 off
No valid host was found. Reason: No conductor service registered which supports driver pxe_ipmitool. (HTTP 404)
[stack@undercloud72 ~]$


[root@undercloud72 ~]# systemctl status openstack-ironic-conductor
● openstack-ironic-conductor.service - OpenStack Ironic Conductor service
   Loaded: loaded (/usr/lib/systemd/system/openstack-ironic-conductor.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2016-02-10 15:02:49 EST; 7h ago
 Main PID: 21724 (ironic-conducto)
   CGroup: /system.slice/openstack-ironic-conductor.service
           └─21724 /usr/bin/python2 /usr/bin/ironic-conductor

Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: verify_requirements=verify_requirements,
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: File "/usr/lib/python2.7/site-packages/stevedore/enabled.py", line 60, in __init__
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: verify_requirements=verify_requirements,
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: File "/usr/lib/python2.7/site-packages/stevedore/extension.py", line 92, in __init__
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: verify_requirements)
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: File "/usr/lib/python2.7/site-packages/stevedore/extension.py", line 170, in _load_plugins
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: self._on_load_failure_callback(self, ep, err)
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: File "/usr/lib/python2.7/site-packages/ironic/common/driver_factory.py", line 117, in _catch_driver_not_found
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: raise exc
Feb 10 15:02:51 undercloud72.localdomain ironic-conductor[21724]: DriverLoadError: Driver PXEDracDriver could not be loaded. Reason: Unable to import python-dracclient library.

Comment 2 Alexander Chuzhoy 2016-05-26 02:40:35 UTC
We hit it with puddle. Fail to deploy last puddle.

Comment 3 Alexander Chuzhoy 2016-05-26 02:42:24 UTC
openstack baremetal import --json instackenv.json
Request returned failure status.
No valid host was found. Reason: No conductor service registered which supports driver pxe_ssh. (HTTP 400)

Comment 5 Dmitry Tantsur 2016-06-10 07:45:21 UTC
*** Bug 1323800 has been marked as a duplicate of this bug. ***

Comment 8 Alexander Chuzhoy 2016-06-10 14:56:15 UTC
Verified:
Environment:
instack-undercloud-2.2.7-7.el7ost.noarch


[stack@instack ~]$ openstack baremetal import --json instackenv.json
[stack@instack ~]$ ironic node-list
+--------------------------------------+------+---------------+-------------+--------------------+-------------+
| UUID                                 | Name | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+------+---------------+-------------+--------------------+-------------+
| 75f996f9-4e3c-4f08-8bb1-2309196cb88d | None | None          | power off   | available          | False       |
| 6f48856a-4a83-4f3b-a317-caa0083c2314 | None | None          | power off   | available          | False       |
| 2e4534ac-debc-4d12-b5b5-e8e70ca993cc | None | None          | power off   | available          | False       |
| 1fe2263a-fabe-48dd-b779-a20368f8f309 | None | None          | power off   | available          | False       |
| 6f61d98d-3943-4f95-9f20-7340dcb9e383 | None | None          | power off   | available          | False       |
| 1aa53601-c189-4fa9-b1e4-d34ef13be550 | None | None          | power off   | available          | False       |
| 6458c100-2ba8-47ac-b731-288c147858ed | None | None          | power off   | available          | False       |
| ba9d96f5-8710-408b-824c-7acf949766ee | None | None          | power off   | available          | False       |
+--------------------------------------+------+---------------+-------------+--------------------+-------------+
[stack@instack ~]$ ironic node-set-power-state 75f996f9-4e3c-4f08-8bb1-2309196cb88d on

[stack@instack ~]$ ironic node-list
+--------------------------------------+------+---------------+-------------+--------------------+-------------+
| UUID                                 | Name | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+------+---------------+-------------+--------------------+-------------+
| 75f996f9-4e3c-4f08-8bb1-2309196cb88d | None | None          | power on    | available          | False       |
| 6f48856a-4a83-4f3b-a317-caa0083c2314 | None | None          | power off   | available          | False       |
| 2e4534ac-debc-4d12-b5b5-e8e70ca993cc | None | None          | power off   | available          | False       |
| 1fe2263a-fabe-48dd-b779-a20368f8f309 | None | None          | power off   | available          | False       |
| 6f61d98d-3943-4f95-9f20-7340dcb9e383 | None | None          | power off   | available          | False       |
| 1aa53601-c189-4fa9-b1e4-d34ef13be550 | None | None          | power off   | available          | False       |
| 6458c100-2ba8-47ac-b731-288c147858ed | None | None          | power off   | available          | False       |
| ba9d96f5-8710-408b-824c-7acf949766ee | None | None          | power off   | available          | False       |
+--------------------------------------+------+---------------+-------------+--------------------+-------------+

Comment 9 Kaihua Chen 2016-06-12 03:02:12 UTC
Hi Alexander,

We hit this issue when OSP8 fresh install. And the the version is 
instack-undercloud-2.2.7-4.el7ost.noarch

And we cannot update the release to the 7, how can we fix this issue? Thanks.

Comment 10 Kaihua Chen 2016-06-12 03:10:57 UTC
If only update the pkg can fix this issue, is it possible to put it here or guide me how to fetch it? Thanks.

Comment 11 Robin Cernin 2016-06-12 06:17:39 UTC
(In reply to Kaihua Chen from comment #10)
> If only update the pkg can fix this issue, is it possible to put it here or
> guide me how to fetch it? Thanks.

If you search thru logs and find something like this:

ironic-conductor[XXX]: DriverLoadError: Driver PXEDracDriver could not be loaded. Reason: Unable to import python-dracclient library.

Then:
undercloud# yum -y install python-dracclient
undercloud# openstack-service restart ironic

Comment 12 Alexander Chuzhoy 2016-06-13 13:53:37 UTC
Hi Kaihua,
The proposed solution in comment #11 (and/or comment #7) work for you?
Thanks.

Comment 14 Jeremy 2016-06-13 20:03:51 UTC
See this for pxe_ilo as well: No valid host was found. Reason: No conductor service registered which supports driver pxe_ilo.

Comment 15 Kaihua Chen 2016-06-14 03:09:07 UTC
(In reply to Alexander Chuzhoy from comment #12)
> Hi Kaihua,
> The proposed solution in comment #11 (and/or comment #7) work for you?
> Thanks.

Hi Alexander,

Thanks. I have used other workaround to fix it. I removed the pxe_drac from the enabled_drivers as I don't use the DELL server.
enabled_drivers=pxe_ipmitool,pxe_ssh,pxe_ilo,pxe_wol

Comment 16 errata-xmlrpc 2016-06-15 12:39:49 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1229


Note You need to log in before you can comment on or make changes to this bug.