Bug 2066658 - Load balancers remain with immutable state
Summary: Load balancers remain with immutable state
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: python-ovn-octavia-provider
Version: 16.2 (Train)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ga
: 17.0
Assignee: Luis Tomas Bolivar
QA Contact: Eran Kuris
URL:
Whiteboard:
Depends On:
Blocks: 2067069 2067070
TreeView+ depends on / blocked
 
Reported: 2022-03-22 09:50 UTC by Maysa Macedo
Modified: 2022-09-21 12:20 UTC (History)
4 users (show)

Fixed In Version: python-ovn-octavia-provider-1.0.1-0.20220411162507.0da5150.el8ost
Doc Type: No Doc Update
Doc Text:
Clone Of:
: 2067069 (view as bug list)
Environment:
Last Closed: 2022-09-21 12:19:42 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Launchpad 1965732 0 None None None 2022-03-22 11:00:38 UTC
OpenStack gerrit 834335 0 None MERGED Avoid loadbalancer stuck in PENDING_X if delete_vip_port fails 2022-04-06 15:28:58 UTC
OpenStack gerrit 835654 0 None MERGED Avoid loadbalancer stuck in PENDING_X if delete_vip_port fails 2022-04-06 15:28:58 UTC
Red Hat Issue Tracker OSP-14103 0 None None None 2022-03-22 09:56:41 UTC
Red Hat Product Errata RHEA-2022:6543 0 None None None 2022-09-21 12:20:14 UTC

Description Maysa Macedo 2022-03-22 09:50:43 UTC
Description of problem:

While running a cluster density[1] test on a OpenShift cluster on top of OpenStack with Kuryr, multiple load-balancers got stuck with pending-* state and Kuryr couldn't perform any operation on them since this is an immutable state.
Neutron might have been overloaded and the proper status update was not sent back to Octavia from ovn-octavia.

$ openstack loadbalancer list |grep PENDING |wc -l
286


[1] https://github.com/cloud-bulldozer

Version-Release number of selected component (if applicable):
$ cat /etc/rhosp-release 
Red Hat OpenStack Platform release 16.2.2 (Train)

How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 12 Itzik Brown 2022-08-29 12:02:30 UTC
1. Ran OCP installation with Kuryr on osp17
2. Exported the variables (export WORKLOAD=cluster-density; export JOB_ITERATIONS=40)
3. Ran https://github.com/cloud-bulldozer/e2e-benchmarking/blob/master/workloads/kube-burner/run.sh
4. Checked that there are no load-balancer with immutable state (PENDING*)

OCP 4.11
OSP RHOS-17.0-RHEL-9-20220816.n.2

Comment 16 errata-xmlrpc 2022-09-21 12:19:42 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 17.0 (Wallaby)), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2022:6543


Note You need to log in before you can comment on or make changes to this bug.