Note: This bug is displayed in read-only format because
the product is no longer active in Red Hat Bugzilla.
RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Descriptionchrisbro@redhat.com
2020-01-14 01:35:38 UTC
Description of problem:
Baremetal node introspection times out with IPA ipmitool-1.8.18-7.el7.x86_64 version
Version-Release number of selected component (if applicable):
openstack-ironic-api-10.1.9-1.el7ost.noarch Fri Nov 8 20:01:38 2019
openstack-ironic-common-10.1.9-1.el7ost.noarch Fri Nov 8 20:01:34 2019
openstack-ironic-conductor-10.1.9-1.el7ost.noarch Fri Nov 8 20:01:42 2019
openstack-ironic-inspector-7.2.4-1.el7ost.noarch Fri Nov 8 20:01:55 2019
openstack-ironic-staging-drivers-0.9.1-2.el7ost.noarch Fri Nov 8 20:01:50 2019
puppet-ironic-12.4.0-5.el7ost.noarch Fri Nov 8 18:16:25 2019
python2-ironicclient-2.2.2-1.el7ost.noarch Fri Nov 8 18:17:03 2019
python2-ironic-neutron-agent-1.0.1-1.el7ost.noarch Fri Nov 8 20:00:42 2019
python-ironic-inspector-client-3.1.2-1.el7ost.noarch Fri Nov 8 18:17:03 2019
python-ironic-lib-2.12.3-1.el7ost.noarch Fri Nov 8 20:01:32 2019
ipmitool-1.8.18-7.el7.x86_64
How reproducible:
Always for the hardware with the current hardware
root 5531 3.4 0.0 228988 47440 tty1 S 11:55 0:50 \_ /usr/bin/python2 /bin/ironic-python-agent --debug
root 5647 0.0 0.0 117324 24376 tty1 S 11:59 0:00 | \_ /usr/bin/python2 /bin/hardware-detect
root 5726 0.0 0.0 24320 1676 tty1 S 11:59 0:00 | \_ ipmitool -I open sdr
Steps to Reproduce:
1. node introspection
2.
3.
Actual results:
impitool -I open sdr is slow, for each line it waits for timeout
Expected results:
Should pass introspection
Additional info:
BZ#1126333
Previously, ipmitool could not recognize the Sensor Data Repository (SDR) type Software ID. As a consequence, the default 5-second timeout for each affected line reported resulted in a very slow response. This update fixes the Intelligent Platform Management Bus (IPMB) request setup, and slow SDR access times are no longer experienced in the described situation.
Note that the "ipmitool -I open sdr" command is used by IPA in python-hardware - https://github.com/redhat-cip/hardware/blob/master/hardware/detect_utils.py#L204.
This version of ipmitool used in RHEL 7 (ipmitool-1.8.18-7.el7.x86_64) is almost 2 years old (Feb. 2018) - https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=652496. The issue seems to be specific to the vendor's BMC implementation in response to this "ipmitool -I open sdr" command, we haven't got any reports of this problem with other hardware. As Dmitry indicated, we should be tracking this as a RHEL/ipmitool issue. We don't have a mechanism for providing the version of ipmitool in ironic-python-agent.
I am also confused regarding the discussion on https://bugzilla.redhat.com/show_bug.cgi?id=1126333, is the idea that this ipmitool fix introduced a regression?
In this particular HW the customer has, we are hitting very similar issue to https://bugzilla.redhat.com/show_bug.cgi?id=1126333, not verified if exactly the same but each line waits for timeout and then moves to the next one. All together caused timeout on the introspection. I agree with everyone that this is not the issue in IPA, it is issue in ipmitool and hence moving this ticket to RHEL and ipmitool component.
Red Hat Enterprise Linux version 7 entered the Maintenance Support 1 Phase in August 2019. In this phase only qualified Critical and Important Security errata advisories (RHSAs) and Urgent Priority Bug Fix errata advisories (RHBAs) may be released as they become available. Other errata advisories may be delivered as appropriate.
This bug has been reviewed by Support and Engineering representative and does not meet the inclusion criteria for Maintenance Support 1 Phase. If this issue still exists in newer major version of Red Hat Enterprise Linux, it has been cloned there and work will continue in the cloned bug.
For more information about Red Hat Enterprise Linux Lifecycle, please see https://access.redhat.com/support/policy/updates/errata/