Bug 2066658

Summary:	Load balancers remain with immutable state
Product:	Red Hat OpenStack	Reporter:	Maysa Macedo <mdemaced>
Component:	python-ovn-octavia-provider	Assignee:	Luis Tomas Bolivar <ltomasbo>
Status:	CLOSED ERRATA	QA Contact:	Eran Kuris <ekuris>
Severity:	high	Docs Contact:
Priority:	high
Version:	16.2 (Train)	CC:	froyo, gthiemon, itbrown, ltomasbo
Target Milestone:	ga	Keywords:	Triaged
Target Release:	17.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	python-ovn-octavia-provider-1.0.1-0.20220411162507.0da5150.el8ost	Doc Type:	No Doc Update
Doc Text:		Story Points:	---
Clone Of:
Clones:	2067069 (view as bug list)		Environment:
Last Closed:	2022-09-21 12:19:42 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	2067069, 2067070

Description Maysa Macedo 2022-03-22 09:50:43 UTC

Description of problem:

While running a cluster density[1] test on a OpenShift cluster on top of OpenStack with Kuryr, multiple load-balancers got stuck with pending-* state and Kuryr couldn't perform any operation on them since this is an immutable state.
Neutron might have been overloaded and the proper status update was not sent back to Octavia from ovn-octavia.

$ openstack loadbalancer list |grep PENDING |wc -l
286


[1] https://github.com/cloud-bulldozer

Version-Release number of selected component (if applicable):
$ cat /etc/rhosp-release 
Red Hat OpenStack Platform release 16.2.2 (Train)

How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 12 Itzik Brown 2022-08-29 12:02:30 UTC

1. Ran OCP installation with Kuryr on osp17
2. Exported the variables (export WORKLOAD=cluster-density; export JOB_ITERATIONS=40)
3. Ran https://github.com/cloud-bulldozer/e2e-benchmarking/blob/master/workloads/kube-burner/run.sh
4. Checked that there are no load-balancer with immutable state (PENDING*)

OCP 4.11
OSP RHOS-17.0-RHEL-9-20220816.n.2

Comment 16 errata-xmlrpc 2022-09-21 12:19:42 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 17.0 (Wallaby)), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2022:6543