Bug 1697925

Summary:	memory leak in openvswitch python wrapper for RDO
Product:	[Community] RDO	Reporter:	Bernard Cafarelli <bcafarel>
Component:	openvswitch	Assignee:	Daniel Alvarez Sanchez <dalvarez>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Ofer Blaut <oblaut>
Severity:	high	Docs Contact:
Priority:	high
Version:	unspecified	CC:	apevec, chrisw, dalvarez, sfahted, srevivo, tredaelli
Target Milestone:	---
Target Release:	Rocky
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-07-10 10:19:50 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Bernard Cafarelli 2019-04-09 10:19:35 UTC

Openvswitch has a a compiled C extension wrapper within the library for speedier JSON processing. This extension was enabled in packaged ovs in 2.9.0-56, and is present in 2.10.1-3.el7 (current version available in RDO rocky repo).

However using this extension causes a memory leak in neutron agents (see #1667007), fixed with this commit:
https://github.com/openvswitch/ovs/commit/e120ff1f8e4dbb0b889b26e0be082376a32090bc

Checking current supported versions in RDO, Ocata/Pike/Queens do not have the 2.9.0-56 mentioned version. Stein/master has 2.11 which includes the fix

However Rocky needs a fixed version, as reported in kolla bug:
https://bugs.launchpad.net/kolla/+bug/1823818

Comment 2 Daniel Alvarez Sanchez 2019-04-09 13:01:56 UTC

The plan is to have OVS and OVN 2.11 packages in RDO Train ASAP and then propose them as well for Stein (Stein is running against 2.11 already but without the split) and Rocky.
We're working on having the packages ready here: https://review.rdoproject.org/r/#/c/20008/


So far, rebuilding 2.11 from the Fedora spec works fine. It's just a matter of having a green CI

Comment 3 Sambedi Fahted 2019-05-28 16:43:35 UTC

I'm running Rocky and have hit this memory leak bug and impacting production systems. 
Is there a timeline for getting this released?

Comment 4 Sambedi Fahted 2019-06-04 16:40:38 UTC

Is there progress on this release?

Comment 5 Sambedi Fahted 2019-06-12 16:18:56 UTC

Hi all.
I'm not trying to be a pest. I'd just like to know if there's a reasonable timeline for when this fix will be released for Rocky? Seems it's ready but just needs to pass CI QC. 

Thank you.

Sam

Comment 6 Daniel Alvarez Sanchez 2019-06-13 09:20:51 UTC

Hi, this already happened few weeks ago in RDO [0][1].

And it's also in CentOS repos [2] since 2019-05-28 09:01 so I wonder why you're not able to use it.

Let us know, I'll wait until you confirm and then close it because all seems good since a couple weeks.

[0] https://review.rdoproject.org/r/#/c/20866/
[1] https://review.rdoproject.org/r/#/c/20916/
[2] http://mirror.centos.org/centos/7/cloud/x86_64/openstack-rocky/

Comment 7 Sambedi Fahted 2019-06-19 18:53:13 UTC

Hi Daniel,
I'm seeing the fix in the repo. Implementing in my environment. 
Thank you so much.

Sam

Comment 8 Sambedi Fahted 2019-07-09 17:32:51 UTC

Hi, Daniel.
I was able to implement the change and all is working great.

Thank you!

Comment 9 Bernard Cafarelli 2019-07-10 10:19:50 UTC

Thanks for the confirmation! Marking as closed with current packages