Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1766111

Summary:	Enable Prometheus local compaction for in-cluster and user workload monitors.
Product:	OpenShift Container Platform	Reporter:	Bartek Plotka <bplotka>
Component:	Monitoring	Assignee:	Bartek Plotka <bplotka>
Status:	CLOSED ERRATA	QA Contact:	Junqi Zhao <juzhao>
Severity:	low	Docs Contact:
Priority:	unspecified
Version:	4.3.0	CC:	alegrand, anpicker, erooth, kakkoyun, lcosic, mloibl, pkrupa, surbania
Target Milestone:	---
Target Release:	4.3.0
Hardware:	All
OS:	All
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2020-01-23 11:09:38 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Bartek Plotka 2019-10-28 10:17:06 UTC

Description of problem:

Prometheus servers for both in-cluster and user workload monitoring has around 2w retention, however compaction disabled.

This is due to Prometheus Operator disabling compaction when the sidecar is enabled. We, however, have sidecar enabled only for query traffic not uploading, so compaction can be enabled on Prometheus.

Without compaction, we can expect significant latency and disk size overhead for Prometheus.

Version-Release number of selected component (if applicable):


Additional info:

* Prometheus-operator upstream change is required.
* Found when investigating https://bugzilla.redhat.com/show_bug.cgi?id=1765315#c6

Comment 1 Bartek Plotka 2019-10-28 10:23:39 UTC

This is low as all still works, just performance for certain queries and disk size might be affected.

Comment 2 Bartek Plotka 2019-11-01 11:53:27 UTC

Upstream PR: https://github.com/coreos/prometheus-operator/pull/2845

Comment 3 Bartek Plotka 2019-11-05 10:48:35 UTC

Bump PR: https://github.com/openshift/prometheus-operator/pull/46 

This will be fixed in the new Prometheus operator version. From that version, both Prometheus-es (user and in-cluster workload) should have compaction enabled.

Comment 8 Bartek Plotka 2019-12-10 12:36:33 UTC

Just to provide info (already responded in the comment): this is was landed in 4.3

Comment 10 errata-xmlrpc 2020-01-23 11:09:38 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:0062