Bug 1930432 - Nova evacuate fails due to timeout waiting for a network-vif-plugged event for instance
Summary: Nova evacuate fails due to timeout waiting for a network-vif-plugged event fo...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-nova
Version: 16.1 (Train)
Hardware: x86_64
OS: Linux
high
medium
Target Milestone: z6
: 16.1 (Train on RHEL 8.2)
Assignee: smooney
QA Contact: James Parker
URL:
Whiteboard:
Depends On: 1917675
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-02-18 20:48 UTC by smooney
Modified: 2024-10-01 17:31 UTC (History)
10 users (show)

Fixed In Version: openstack-nova-20.4.1-1.20201114041752.el8ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-05-26 13:51:32 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-773 0 None None None 2022-09-05 13:18:32 UTC
Red Hat Product Errata RHBA-2021:2097 0 None None None 2021-05-26 13:52:12 UTC

Description smooney 2021-02-18 20:48:42 UTC
This bug was initially created as a copy of Bug #1917675

I am copying this bug because: 



Description of problem:
Nova evacuate fails due to timeout waiting for a network-vif-plugged event for instance

Version-Release number of selected component (if applicable):


How reproducible:
100% evacuation after rebooting the instance

Steps to Reproduce:
1. Stop a compute node:
   $ openstack compute service set --disable --down compute-0 nova-compute
   $ openstack baremetal node power off compute-0
2. Evacuate an instance on the node: nova evacuate <instance-id>
3. The status of the instance changed from ACTIVE to ERROR, finally

Actual results:
The status of the instance changed from ACTIVE to REBUILD, then ERROR

Expected results:
The status of the instance changed from ACTIVE to REBUILD, then ACTIVE

Additional info:
The network is OVS.

Unexpected event network-vif-plugged-<PORT-ID> received before preparing to wait for external event network-vif-plugged-<PORT-ID> like the following.

~~~
...
2021-01-18 18:07:51.043 7 WARNING nova.compute.manager Received unexpected event network-vif-plugged-<PORT-ID> for instance with vm_state active and task_state rebuilding.
...
2021-01-18 18:07:53.841 7 DEBUG nova.compute.manager Preparing to wait for external event network-vif-plugged-<PORT-ID>
...
2021-01-18 18:12:56.131 7 ERROR nova.compute.manager Setting instance vm_state to ERROR
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 6442, in _create_domain_and_network
    network_info)
  File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 478, in wait_for_instance_event
    actual_event = event.wait()
  File "/usr/lib/python3.6/site-packages/eventlet/event.py", line 125, in wait
    result = hub.switch()
  File "/usr/lib/python3.6/site-packages/eventlet/hubs/hub.py", line 298, in switch
    return self.greenlet.switch()
eventlet.timeout.Timeout: 300 seconds
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 8974, in _error_out_instance_on_exception
    yield
  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 3388, in rebuild_instance
    migration, request_spec, allocs)
  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 3450, in _do_rebuild_instance_with_claim
    self._do_rebuild_instance(*args, **kwargs)
  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 3610, in _do_rebuild_instance
    self._rebuild_default_impl(**kwargs)
  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 3275, in _rebuild_default_impl
    block_device_info=new_block_device_info)
  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 3647, in spawn
    cleanup_instance_disks=created_disks)
  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 6465, in _create_domain_and_network
    raise exception.VirtualInterfaceCreateException()
nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
...
~~~

Comment 16 errata-xmlrpc 2021-05-26 13:51:32 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 16.1.6 bug fix and enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:2097


Note You need to log in before you can comment on or make changes to this bug.