Bug 1944027

Summary: Memory leaks in library used by ceilometer-notification
Product: Red Hat OpenStack Reporter: Michele Valsecchi <mvalsecc>
Component: python-ujsonAssignee: Matthias Runge <mrunge>
Status: CLOSED ERRATA QA Contact: Leonid Natapov <lnatapov>
Severity: medium Docs Contact:
Priority: medium    
Version: 16.1 (Train)CC: apevec, csibbitt, jjoyce, jschluet, lhh, mrunge, pkilambi, pleimer, spower
Target Milestone: z6Keywords: Rebase, Triaged, ZStream
Target Release: 16.1 (Train on RHEL 8.2)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: python-ujson-2.0.3-2.el8ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1948452 1948453 (view as bug list) Environment:
Last Closed: 2021-05-26 13:52:17 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1948452, 1948453    

Description Michele Valsecchi 2021-03-29 05:38:25 UTC 
Description of problem:
Memory leak[1] in underlying ultrajson library inside ceilometer-notification

Version-Release number of selected component (if applicable):
16.1, 16.1.4 latest container image (16.1-51 at the time of writing [2]).

How reproducible:
See https://bugzilla.redhat.com/show_bug.cgi?id=1939112

Steps to Reproduce:
See https://bugzilla.redhat.com/show_bug.cgi?id=1939112

Actual results:
Controllers' memory usage keeps increasing due to above mentioned memory leak.

Expected results:
Memory should be reclaimed, and no memory usage constant increase should be seen on the Controller nodes

Additional info:

PR #394[1] is not contained in ultrajson 2.0.0, used by latest ceilometer image

from [2]
~~~
python3-ujson-2.0-0.1.20170206git2f1d487.el8ost.7.x86_64
~~~

but it is contained in 2.0.3 [4]
~~~
 $ git tag --contains 92c57b421052b146e4f2dfce9386c7cf13241091 | grep 2.0
2.0.3 <===
3.2.0
~~~

Need to bump ultrajson version to at least 2.0.3


[1] https://github.com/ultrajson/ultrajson/pull/394/commits/92c57b421052b146e4f2dfce9386c7cf13241091
[2] https://catalog.redhat.com/software/containers/rhosp-rhel8/openstack-ceilometer-notification/5de6af84d70cc51644a56d7b?tag=16.1-51&push_date=1600264861000&container-tabs=packages
[3] https://github.com/ultrajson/ultrajson/releases/tag/2.0.0
[4] https://github.com/ultrajson/ultrajson/releases/tag/2.0.3
Comment 5 Matthias Runge 2021-03-29 07:48:25 UTC 
worth mentioning, that 1.35 is in upper constraints for train https://github.com/openstack/requirements/blob/stable/train/upper-constraints.txt#L341
Comment 7 Matthias Runge 2021-03-30 13:57:22 UTC 
https://review.rdoproject.org/r/c/rdoinfo/+/32852 for wallaby, needs backport.
Comment 8 Matthias Runge 2021-04-01 10:39:11 UTC 
Backport to victoria https://review.rdoproject.org/r/c/rdoinfo/+/32963
Comment 9 Matthias Runge 2021-04-01 12:39:17 UTC 
Fedora spec for versio 2.0.3 https://src.fedoraproject.org/rpms/python-ujson/tree/5b97bf059e6dcd68e81e6be9ac733ac9075ab0b4
Comment 19 Leonid Natapov 2021-05-19 10:31:12 UTC 
Verified. Could not reproduce.  Please re-open if the issue reproduces
Comment 25 errata-xmlrpc 2021-05-26 13:52:17 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 16.1.6 bug fix and enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:2097