Bug 1999057

Summary:	Drop high cardinality cAdvisor metrics
Product:	OpenShift Container Platform	Reporter:	Philip Gough <pgough>
Component:	Monitoring	Assignee:	Philip Gough <pgough>
Status:	CLOSED INSUFFICIENT_DATA	QA Contact:	hongyan li <hongyli>
Severity:	high	Docs Contact:
Priority:	high
Version:	4.8	CC:	amuller, anpicker, aos-bugs, arajkuma, erooth, hongyli, jdelft, juzhao, spasquie
Target Milestone:	---
Target Release:	4.8.z
Hardware:	All
OS:	All
Whiteboard:
Fixed In Version:		Doc Type:	Enhancement
Doc Text:	Feature: Drops selected set of high cardinality metrics from cAdvisor. Reason: To reduce the overall memory footprint of Promtheus. Result: Lowers the overall count of time series stored by Prometheus.	Story Points:	---
Clone Of:	1997034
Clones:	1999072 (view as bug list)		Environment:
Last Closed:	2021-11-10 10:55:06 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1997034
Bug Blocks:	1999072

Description Philip Gough 2021-08-30 10:55:54 UTC

+++ This bug was initially created as a clone of Bug #1997034 +++

Description of problem:

To reduce the overall memory consumption of Prometheus, we can drop unused cAdvisor metrics with high cardinality.

Version-Release number of selected component (if applicable):

4.8


Additional info:

This can be verified by a before and after query: count({metrics_path="/metrics/cadvisor"})

--- Additional comment from Junqi Zhao on 2021-08-30 08:49:53 UTC ---

tested with 4.9.0-0.nightly-2021-08-29-010334
with the fix, the count of the cadvisor metrics is less than that without the fix
count({metrics_path="/metrics/cadvisor"})
{} 46166

without the fix
count({metrics_path="/metrics/cadvisor"})
{} 56388