Bug 1733825

Summary: Incorrect memory usage for openshift-monitoring namespace
Product: OpenShift Container Platform Reporter: Junqi Zhao <juzhao>
Component: MonitoringAssignee: Sergiusz Urbaniak <surbania>
Status: CLOSED ERRATA QA Contact: Viacheslav <mviaches>
Severity: medium Docs Contact:
Priority: medium    
Version: 4.2.0CC: alegrand, anpicker, ccoleman, erooth, mloibl, pkrupa, surbania
Target Milestone: ---Keywords: Regression
Target Release: 4.2.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-10-16 06:33:51 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
Incorrect memory usage none

Description Junqi Zhao 2019-07-29 01:38:44 UTC
Created attachment 1594132 [details]
Incorrect memory usage

Description of problem:
Check memory usage for openshift-monitoring namespace in cluster console, it is only 66.09MB,
from the "Memory Usage by Pod (Top 10)" part, prometheus-k8s-0 already use 1.2GB.

it uses
namespace:container_memory_usage_bytes:sum{namespace='openshift-monitoring'}
to caculate the memory usage

search in prometheus, result is
**************************************
Element	Value
namespace:container_memory_usage_bytes:sum{label_name="prometheus-adapter",namespace="openshift-monitoring"}	66093056
namespace:container_memory_usage_bytes:sum{namespace="openshift-monitoring"}	2564440064
**************************************

Version-Release number of selected component (if applicable):
4.2.0-0.nightly-2019-07-28-222114

How reproducible:
Always

Steps to Reproduce:
1. See the description
2.
3.

Actual results:
Incorrect memory usage for openshift-monitoring namespace

Expected results:
correct memory usage for openshift-monitoring namespace

Additional info:

Comment 10 Sergiusz Urbaniak 2019-08-27 13:12:04 UTC
*** Bug 1745654 has been marked as a duplicate of this bug. ***

Comment 17 Viacheslav 2019-09-06 09:39:10 UTC
Still exist on build 4.2.0-0.nightly-2019-09-05-234433

Comment 18 Junqi Zhao 2019-09-09 01:51:18 UTC
fixed with 4.2.0-0.nightly-2019-09-08-180038

sum by(namespace) (container_memory_working_set_bytes{namespace="openshift-monitoring",container="",pod!=""})
Element	Value
{namespace="openshift-monitoring"}	2888843264

Comment 19 errata-xmlrpc 2019-10-16 06:33:51 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:2922