Bug 2270223 - [CEE] portal doesn't show Graphs in the RGW sync overview page
Summary: [CEE] portal doesn't show Graphs in the RGW sync overview page
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: Ceph-Dashboard
Version: 6.1
Hardware: All
OS: Linux
unspecified
medium
Target Milestone: ---
: 6.1z7
Assignee: avan
QA Contact: Chaithra
Rivka Pollack
URL:
Whiteboard:
Depends On:
Blocks: 2271133 2271135 2304284
TreeView+ depends on / blocked
 
Reported: 2024-03-19 04:09 UTC by Tridibesh Chakraborty
Modified: 2024-08-28 17:59 UTC (History)
10 users (show)

Fixed In Version: ceph-17.2.6-222
Doc Type: Bug Fix
Doc Text:
.Grafana dashboard now shows RGW Sync Overview page graphs Previously, due to regex for the Ceph Object Gateway sync metrics in ceph-exporter, the Grafana dashboards did not display the RGW Sync Overview page graphs. In place of the graphs, the ‘No Data’ message was displayed. With this fix, the ceph-exporter provides the desired metrics value with the expected labels and the RGW sync overview page shows all data correctly.
Clone Of:
: 2271133 2271135 2304284 (view as bug list)
Environment:
Last Closed: 2024-08-28 17:58:56 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Ceph Project Bug Tracker 65091 0 None None None 2024-03-22 22:00:35 UTC
Github ceph ceph pull 56421 0 None open exporter: fix regex for rgw sync metrics 2024-03-22 22:00:35 UTC
Red Hat Issue Tracker RHCEPH-8554 0 None None None 2024-03-19 04:13:27 UTC
Red Hat Issue Tracker RHCSDASH-1316 0 None None None 2024-03-19 04:13:29 UTC
Red Hat Product Errata RHBA-2024:5960 0 None None None 2024-08-28 17:59:19 UTC

Description Tridibesh Chakraborty 2024-03-19 04:09:39 UTC
Description of problem:

On RHCS 6.1z4 and lower versions, Ceph Grafana dashboard doesn't show the Graphs in RGW sync overview page as it complains about "No Data". If I set `mgr/prometheus/exclude_perf_counters` as false, then the Graphs are getting populated. Also OSD overview page doesn't show most of the graphs like OSD read latency, write latency, highest read latency, highest write latency etc. This doesn't change with setting `mgr/prometheus/exclude_perf_counters` as false. 

So looks like ceph-exporter is not working properly which is introduced in RHCS 6.1. 

Version-Release number of selected component (if applicable):
17.2.6-196.el9cp

How reproducible:

It is happening all the time in both customer environment and in my lab setup. 


Steps to Reproduce:

- Install 2 RHCS 6.1z2 clusters
- Setup RGW multisite between them
- Verify the RGW sync overview page in Grafana portal for both the sites. The Graphs will be showing as "No Data".
- Modify the parameter `mgr/prometheus/exclude_perf_counters` as false. 
- Verify the Graphs under RGW sync overview page. They will be showing data. 
- Reset the parameter
- Upgrade the cluster to the latest RHCS 6.1z4 and verify the Graphs. They will be showing no data again. 
- Change the parameter to false again. Now the Graphs will be populated properly.


Actual results:

Graphs are showing "No data"

Expected results:

Graphs should be populated with actual data

Additional info:

Similar issue was observed on the BZ#2224967 and Engineering provided workaround to set the parameter mgr/prometheus/exclude_perf_counters as false and the fix was supposed to be introduced on RHCS 6.1z2. But looks like it is still not fixed or partially fixed.

Comment 34 errata-xmlrpc 2024-08-28 17:58:56 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 6.1 security, bug fix, and enhancement updates.), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2024:5960


Note You need to log in before you can comment on or make changes to this bug.