Bug 1848687 - haproxy current sessions data in Prometheus keep increasing
Summary: haproxy current sessions data in Prometheus keep increasing
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Networking
Version: 4.4
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: 4.4.z
Assignee: Andrew McDermott
QA Contact: Arvind iyengar
URL:
Whiteboard:
Depends On: 1832539
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-06-18 18:18 UTC by Clayton Coleman
Modified: 2023-01-17 09:06 UTC (History)
16 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 1832539
Environment:
Last Closed: 2020-07-21 10:31:06 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
Prometheus graph data from patched cluster version (196.43 KB, image/png)
2020-07-13 08:13 UTC, Arvind iyengar
no flags Details
Promethrus Graph data for unpatched cluster environment (189.24 KB, image/png)
2020-07-13 08:14 UTC, Arvind iyengar
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Github openshift origin pull 25165 0 None closed Bug 1848687: Fix router metrics to be accurate in 4.4 2021-02-10 03:31:28 UTC
Github openshift router pull 141 0 None closed Bug 1848687: Ensure router metrics are accurate and increase coverage 2021-02-10 03:31:28 UTC
Red Hat Product Errata RHBA-2020:2913 0 None None None 2020-07-21 10:31:41 UTC

Description Clayton Coleman 2020-06-18 18:18:56 UTC
+++ This bug was initially created as a clone of Bug #1832539 +++

Description of problem:
From Prometheus, we can see haproxy exporter.

haproxy_frontend_current_session or haproxy_server_current_session should show active sessions but it does not show like that. It seems that the number of sessions keeps increasing. From my test environment, there is no load that's why I can see session decresement after load testing. However, for production cluster, it goes to 15 million with ocp 3.11 and 8k with ocp 4.4

Comment 1 Andrew McDermott 2020-06-19 12:00:52 UTC
This is POST but adding UpcomingSprint for housekeeping. And:

I’m adding UpcomingSprint, because I was occupied by fixing bugs with
higher priority/severity, developing new features with higher
priority, or developing new features to improve stability at a macro
level. I will revisit this bug next sprint.

Comment 4 Arvind iyengar 2020-07-13 08:12:35 UTC
The PR merge made into "4.4.0-0.nightly-2020-07-08-233114" release. It is noted that the fix works as intended where "haproxy_frontend_current_sessions" shows consistent results during the idle condition in comparison to non patched payload.

Comment 5 Arvind iyengar 2020-07-13 08:13:36 UTC
Created attachment 1700781 [details]
Prometheus graph data from patched cluster version

Comment 6 Arvind iyengar 2020-07-13 08:14:42 UTC
Created attachment 1700782 [details]
Promethrus Graph data for unpatched cluster environment

Comment 8 errata-xmlrpc 2020-07-21 10:31:06 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:2913


Note You need to log in before you can comment on or make changes to this bug.