Bug 1813640 - Instances on error: 'Failed to allocate networks(s)' as neutron fails to prioritize port create
Summary: Instances on error: 'Failed to allocate networks(s)' as neutron fails to prio...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-neutron
Version: 13.0 (Queens)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: z12
: 13.0 (Queens)
Assignee: Brian Haley
QA Contact: Eran Kuris
URL:
Whiteboard:
: 1832349 (view as bug list)
Depends On:
Blocks: 1381612
TreeView+ depends on / blocked
 
Reported: 2020-03-15 04:11 UTC by Srinivas Atmakuri
Modified: 2023-10-06 19:28 UTC (History)
11 users (show)

Fixed In Version: openstack-neutron-12.1.1-13.el7ost
Doc Type: Bug Fix
Doc Text:
This update assigns higher priority to port create and update messages received by the neutron DHCP agent during processing to decrease 'Failed to allocate network' errors when booting instances.
Clone Of:
: 1820379 (view as bug list)
Environment:
Last Closed: 2020-06-24 11:53:08 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 709824 0 None MERGED Prioritize port create and update ready messages 2021-01-28 16:33:04 UTC
OpenStack gerrit 714193 0 None MERGED Revert "Switch to use cast method in dhcp_ready_on_ports method" 2021-01-28 16:33:04 UTC
Red Hat Issue Tracker OSP-29412 0 None None None 2023-10-06 19:28:12 UTC
Red Hat Product Errata RHBA-2020:2724 0 None None None 2020-06-24 11:53:32 UTC

Description Srinivas Atmakuri 2020-03-15 04:11:20 UTC 
Description of problem:
Seen a lot of instances on error related to 'Failed to allocate network(s)' problem which is related to networks with a large number of ports that are syncing with neutron server.

If a new DHCP port is getting created it's queued up and it takes more than 300 secs to be processed resulting on nova failing to attach the interface.

Version-Release number of selected component (if applicable):
Red Hat OpenStack Platform - 13 (RHOSP-13)

How reproducible:
The problem occurs under heavier load

Steps to Reproduce:
1. 
2.
3.

Actual results:
Instances fail.

Expected results:
Instances to not fail.

Additional info:
An upstream patch https://review.opendev.org/#/c/709824/ seem to address this issue.
Comment 2 Bernard Cafarelli 2020-03-16 14:41:47 UTC 
Please note that linked review is still marked as in progress in master development - we will push to make progress on it, working on backport for queens/OSP13 will only be possible after that
Comment 29 Bernard Cafarelli 2020-05-11 08:08:22 UTC 
*** Bug 1832349 has been marked as a duplicate of this bug. ***
Comment 31 Brian Haley 2020-06-15 19:53:51 UTC 
Added doc text.
Comment 33 errata-xmlrpc 2020-06-24 11:53:08 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:2724
Note You need to log in before you can comment on or make changes to this bug.