Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1582168

Summary: [BACKPORT][OSP10] Skip NICs that say they are ready but are unreadable
Product: Red Hat OpenStack Reporter: Eduard Barrera <ebarrera>
Component: openstack-ironic-python-agentAssignee: Dmitry Tantsur <dtantsur>
Status: CLOSED ERRATA QA Contact: mlammon
Severity: medium Docs Contact:
Priority: medium    
Version: 10.0 (Newton)CC: bfournie, dcadzow, dtantsur, ebarrera, jjoyce, jschluet, mburns, slinaber, tvignaud
Target Milestone: z9Keywords: FeatureBackport, Triaged, ZStream
Target Release: 10.0 (Newton)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-ironic-python-agent-1.5.2-5.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-09-17 16:59:20 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Eduard Barrera 2018-05-24 12:21:02 UTC
Description of problem:

We are having introspection issues with LLDP

The agent is failing and is not allowing the boot interface to get IP address and the the introspection fails


May 23 09:56:32 localhost.localdomain kernel: Command line: ipa-inspection-callback-url=http://172.31.255.1:5050/v1/continue ipa-inspection-collectors=default,extra-hardware,logs systemd.journald.forward_to_console=yes 
BOOTIF=ec:0d:9a:85:24:32 <========
ipa-inspection-dhcp-all-interfaces=1
ipa-collect-lldp=1 initrd=agent.ramdisk


May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.303 1063 INFO ironic_python_agent.netutils [-] Waiting on LLDP info for interfaces: [('ens5f0', <socket._socketobject object at 0x26ff9f0>), ('ens5f1', <socket._socketobject object at 0x26ff980>), ('ens31f1', <socket._socketobject object at 0x26ffa60>), ('ens31f0', <socket._socketobject object at 0x26ffad0>)], timeout: 30.0
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 INFO ironic_python_agent.netutils [-] Found LLDP info for interface: ens5f0
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils [-] Error while getting LLDP info: [Errno 100] Network is down
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils Traceback (most recent call last):
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils   File "/usr/lib/python2.7/site-packages/ironic_python_agent/netutils.py", line 112, in get_lldp_info
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils     return _get_lldp_info(interfaces)
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils   File "/usr/lib/python2.7/site-packages/ironic_python_agent/netutils.py", line 185, in _get_lldp_info
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils     _receive_lldp_packets(s))
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils   File "/usr/lib/python2.7/site-packages/ironic_python_agent/netutils.py", line 146, in _receive_lldp_packets
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils     pkt = sock.recv(1600)
May 23 09:56:40 localhost.localdomain ironic-python-agent[1063]: 2018-05-23 09:56:40.304 1063 ERROR ironic_python_agent.netutils error: [Errno 100] Network is down


network interfaces: 
{
'ens31f1': {'ip': None, 'mac': 'ec:0d:9a:a1:0f:0d'},
'ens5f1': {'ip': '172.31.255.226', 'mac': 'ec:0d:9a:85:24:33'}, 
'ens5f0': {'ip': None, 'mac': 'ec:0d:9a:85:24:32'},  <===========================
'ens31f0': {'ip': None, 'mac': 'ec:0d:9a:a1:0f:0c'}}


There are various patches improving LLDP handling, for example




https://review.openstack.org/#/c/434385/4



Setting ipa-collect-lldp=0 in /httpboot/inspector.ipxe is the currently used workaround for this problem. After disabling LLDP, introspection completes without error.


Version-Release number of selected component (if applicable):
OSP


How reproducible:
ALWAYS

Steps to Reproduce:
1.Unsure
2.
3.

Actual results:
Introspection fails

Expected results:
introspection success

Additional info:

Comment 7 mlammon 2018-08-08 17:26:41 UTC
Not really anything can do to verify.  We will mark verified and if problem re-occurs then to file a new bug or re-open.

Comment 9 Alex McLeod 2018-09-03 08:04:03 UTC
Hi there,

If this bug requires doc text for errata release, please set the 'Doc Type' and provide draft text according to the template in the 'Doc Text' field.

The documentation team will review, edit, and approve the text.

If this bug does not require doc text, please set the 'requires_doc_text' flag to -.

Thanks,
Alex

Comment 11 errata-xmlrpc 2018-09-17 16:59:20 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:2671