RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1790710 - Baremetal node introspection times out with IPA ipmitool version 1.8.18
Summary: Baremetal node introspection times out with IPA ipmitool version 1.8.18
Keywords:
Status: CLOSED WONTFIX
Alias: None
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: ipmitool
Version: 7.7
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: rc
: ---
Assignee: Vaclav Dolezal
QA Contact: Rachel Sibley
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-01-14 01:35 UTC by chrisbro@redhat.com
Modified: 2023-03-24 16:42 UTC (History)
8 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-01-30 12:25:59 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)

Description chrisbro@redhat.com 2020-01-14 01:35:38 UTC 
Description of problem:
Baremetal node introspection times out with IPA ipmitool-1.8.18-7.el7.x86_64 version 

Version-Release number of selected component (if applicable):

openstack-ironic-api-10.1.9-1.el7ost.noarch                 Fri Nov  8 20:01:38 2019
openstack-ironic-common-10.1.9-1.el7ost.noarch              Fri Nov  8 20:01:34 2019
openstack-ironic-conductor-10.1.9-1.el7ost.noarch           Fri Nov  8 20:01:42 2019
openstack-ironic-inspector-7.2.4-1.el7ost.noarch            Fri Nov  8 20:01:55 2019
openstack-ironic-staging-drivers-0.9.1-2.el7ost.noarch      Fri Nov  8 20:01:50 2019
puppet-ironic-12.4.0-5.el7ost.noarch                        Fri Nov  8 18:16:25 2019
python2-ironicclient-2.2.2-1.el7ost.noarch                  Fri Nov  8 18:17:03 2019
python2-ironic-neutron-agent-1.0.1-1.el7ost.noarch          Fri Nov  8 20:00:42 2019
python-ironic-inspector-client-3.1.2-1.el7ost.noarch        Fri Nov  8 18:17:03 2019
python-ironic-lib-2.12.3-1.el7ost.noarch                    Fri Nov  8 20:01:32 2019

ipmitool-1.8.18-7.el7.x86_64

How reproducible:
Always for the hardware with the current hardware

root       5531  3.4  0.0 228988 47440 tty1     S    11:55   0:50      \_ /usr/bin/python2 /bin/ironic-python-agent --debug
root       5647  0.0  0.0 117324 24376 tty1     S    11:59   0:00      |   \_ /usr/bin/python2 /bin/hardware-detect
root       5726  0.0  0.0  24320  1676 tty1     S    11:59   0:00      |       \_ ipmitool -I open sdr

Steps to Reproduce:
1. node introspection
2.
3.

Actual results:

impitool -I open sdr is slow, for each line it waits for timeout

Expected results:

Should pass introspection 

Additional info:

BZ#1126333
    Previously, ipmitool could not recognize the Sensor Data Repository (SDR) type Software ID. As a consequence, the default 5-second timeout for each affected line reported resulted in a very slow response. This update fixes the Intelligent Platform Management Bus (IPMB) request setup, and slow SDR access times are no longer experienced in the described situation.
Comment 5 Dmitry Tantsur 2020-01-14 13:25:16 UTC 
Hi! Does it mean that we've got a regression from https://bugzilla.redhat.com/show_bug.cgi?id=1126333? Should this bug be filed against ipmitool then?
Comment 6 Bob Fournier 2020-01-14 16:26:43 UTC 
Note that the "ipmitool -I open sdr" command is used by IPA in python-hardware - https://github.com/redhat-cip/hardware/blob/master/hardware/detect_utils.py#L204.

This version of ipmitool used in RHEL 7 (ipmitool-1.8.18-7.el7.x86_64) is almost 2 years old (Feb. 2018) - https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=652496.  The issue seems to be specific to the vendor's BMC implementation in response to this "ipmitool -I open sdr" command, we haven't got any reports of this problem with other hardware.  As Dmitry indicated, we should be tracking this as a RHEL/ipmitool issue.  We don't have a mechanism for providing the version of ipmitool in ironic-python-agent.

I am also confused regarding the discussion on https://bugzilla.redhat.com/show_bug.cgi?id=1126333, is the idea that this ipmitool fix introduced a regression?
Comment 7 Robin Cernin 2020-01-14 22:15:49 UTC 
In this particular HW the customer has, we are hitting very similar issue to https://bugzilla.redhat.com/show_bug.cgi?id=1126333, not verified if exactly the same but each line waits for timeout and then moves to the next one. All together caused timeout on the introspection. I agree with everyone that this is not the issue in IPA, it is issue in ipmitool and hence moving this ticket to RHEL and ipmitool component.
Comment 12 Vaclav Dolezal 2020-01-30 12:25:59 UTC 
Red Hat Enterprise Linux version 7 entered the Maintenance Support 1 Phase in August 2019. In this phase only qualified Critical and Important Security errata advisories (RHSAs) and Urgent Priority Bug Fix errata advisories (RHBAs) may be released as they become available. Other errata advisories may be delivered as appropriate.

This bug has been reviewed by Support and Engineering representative and does not meet the inclusion criteria for Maintenance Support 1 Phase. If this issue still exists in newer major version of Red Hat Enterprise Linux, it has been cloned there and work will continue in the cloned bug.

For more information about Red Hat Enterprise Linux Lifecycle, please see https://access.redhat.com/support/policy/updates/errata/
Note You need to log in before you can comment on or make changes to this bug.