Bug 1966428 - Collectd memory consumption is growing gradually causing 'out of memory' issue on nodes.
Summary: Collectd memory consumption is growing gradually causing 'out of memory' issu...
Keywords:
Status: CLOSED INSUFFICIENT_DATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: python-collectd-gnocchi
Version: 16.1 (Train)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: z9
: 16.1 (Train on RHEL 8.2)
Assignee: OSP Team
QA Contact: Leonid Natapov
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-06-01 07:37 UTC by Shravan Kumar Tiwari
Modified: 2023-09-15 01:14 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1969895 (view as bug list)
Environment:
Last Closed: 2022-03-22 15:49:47 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-4320 0 None None None 2021-11-17 09:29:43 UTC

Description Shravan Kumar Tiwari 2021-06-01 07:37:45 UTC 
Description of problem:

Customer has recently FFUed from RHOSP13 to RHOSP16.1 and then enabled the legacy telemetry services and using collectd.

after upgrade the collectd memory was growing rapidly and causing out of memory on the nodes. Some best practices were followed like removing the STF configurations and keping only legacy telemetry configs, removing extra plugins from collectd, configure WriteQueueLimitLow/WriteQueueLimitHigh, and increasing the time interval between metric collection.

This has helped to improve the memory consumption problme significantly, but over the period of time it is observed that collectd memory usage is increasing in controller/compute/ceph nodes and ceilometer-agent memory usage is also increasing in controller node.
Comment 11 Matthias Runge 2022-03-22 15:49:47 UTC 
Closing this, since there was no response.
Comment 12 Red Hat Bugzilla 2023-09-15 01:08:48 UTC 
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 500 days
Note You need to log in before you can comment on or make changes to this bug.