Bug 1966428

Summary:	Collectd memory consumption is growing gradually causing 'out of memory' issue on nodes.
Product:	Red Hat OpenStack	Reporter:	Shravan Kumar Tiwari <shtiwari>
Component:	python-collectd-gnocchi	Assignee:	OSP Team <rhos-maint>
Status:	CLOSED INSUFFICIENT_DATA	QA Contact:	Leonid Natapov <lnatapov>
Severity:	high	Docs Contact:
Priority:	high
Version:	16.1 (Train)	CC:	csibbitt, lmadsen, mrunge, rhayakaw
Target Milestone:	z9	Keywords:	Triaged, ZStream
Target Release:	16.1 (Train on RHEL 8.2)
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:
Clones:	1969895 (view as bug list)		Environment:
Last Closed:	2022-03-22 15:49:47 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Shravan Kumar Tiwari 2021-06-01 07:37:45 UTC

Description of problem:

Customer has recently FFUed from RHOSP13 to RHOSP16.1 and then enabled the legacy telemetry services and using collectd.

after upgrade the collectd memory was growing rapidly and causing out of memory on the nodes. Some best practices were followed like removing the STF configurations and keping only legacy telemetry configs, removing extra plugins from collectd, configure WriteQueueLimitLow/WriteQueueLimitHigh, and increasing the time interval between metric collection.

This has helped to improve the memory consumption problme significantly, but over the period of time it is observed that collectd memory usage is increasing in controller/compute/ceph nodes and ceilometer-agent memory usage is also increasing in controller node.

Comment 11 Matthias Runge 2022-03-22 15:49:47 UTC

Closing this, since there was no response.

Comment 12 Red Hat Bugzilla 2023-09-15 01:08:48 UTC

The needinfo request[s] on this closed bug have been removed as they have been unresolved for 500 days