Bug 1980436 - Neutron misses OVSDB events under the load
Summary: Neutron misses OVSDB events under the load
Keywords:
Status: ASSIGNED
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-neutron
Version: 16.1 (Train)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: ---
Assignee: Miro Tomaska
QA Contact: Eran Kuris
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-07-08 16:31 UTC by Asma Syed Hameed
Modified: 2023-04-24 15:11 UTC (History)
18 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-6065 0 None None None 2021-12-22 20:18:08 UTC

Comment 1 Artom Lifshitz 2021-07-09 19:47:36 UTC
While this is manifesting itself in Nova, I'm fairly certain the root cause is in Neutron/OVN. Nova waits for Neutron to tell it that the vif has been plugged by sending a so called "external event". It's basically Neutron making a POST request to the Nova API telling it "I've plugged this port." In this case, Nova never receives those events, and fails the VM creation.

Comment 2 anil venkata 2021-07-12 08:20:25 UTC
Artome, but why nova is timing out after 300 seconds though we increased it to to 1200 (i.e  vif_plugging_timeout=1200)?

Comment 3 Artom Lifshitz 2021-07-13 09:01:19 UTC
(In reply to anil venkata from comment #2)
> Artome, but why nova is timing out after 300 seconds though we increased it
> to to 1200 (i.e  vif_plugging_timeout=1200)?

Where did you make this change? This should normally be done on the computes, and nova_compute has to be restarted after the change for it to take effect.

Comment 4 anil venkata 2021-07-13 10:55:09 UTC
yes, we have added in the compute and restarted nova_compute

Comment 6 Artom Lifshitz 2021-07-19 10:13:19 UTC
(In reply to anil venkata from comment #4)
> yes, we have added in the compute and restarted nova_compute

I'm not sure what to tell you. I've tried searching through the logs for any mention of vif_plugging_timeout, but without success. Any Nova service should log its configuration when it starts, so the fact that I couldn't find it logged anywhere would indicate that perhaps it wasn't restarted?

To be explicit, the option is in the [DEFAULT] section in nova.conf that's shared between the nova_libvirt and nova_compute containers. So to set it, you need to edit the file that's somewhere in /var/lib/puppet-generated for the nova_libvirt containers (apologies for not providing the exact path, I don't have a 16.1 environment handy to double check).

I hope that helps a bit.


Note You need to log in before you can comment on or make changes to this bug.