Bug 1929346

Summary: [cee/sd][RFE][RGW] Add operation (GET, PUT, DELETE, ...) counters/trackers in RadosGW per bucket and users
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Tomas Petr <tpetr>
Component: RGWAssignee: Ali Maredia <amaredia>
Status: CLOSED ERRATA QA Contact: Chaithra <ckulal>
Severity: low Docs Contact: Rivka Pollack <rpollack>
Priority: medium    
Version: 4.2CC: adking, akraj, amaredia, athakkar, cbodley, ceph-eng-bugs, ckulal, dparkes, dwalveka, kbader, mbenjamin, mhackett, nravinas, rsachere, smykhail, swachira, tserlin
Target Milestone: ---Keywords: FutureFeature
Target Release: 7.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ceph-18.2.0-100.el9cp Doc Type: Enhancement
Doc Text:
.Perf counters for S3 operations can now be sent Prometheus With this enhancement, you can send a new labeled counter to Prometheus by using the Ceph exporter daemon and is useful for common S3 operations, such as PUTs, which can be visualized per bucket or per user. Perf counters for S3 operations labeled by either the user or the bucket are emitted by using the `ceph counter dump` command.
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-12-13 15:18:34 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2237662    

Description Tomas Petr 2021-02-16 17:28:46 UTC
Description of problem:
Add counters for client operations per users and buckets to be able monitor it via dashboard. 

To have RadosGW able store this information in counters/trackers and share this information with prometheus in order to be able to display it in the Ceph dashboard (a similar RFE will be opened to display this information).

What we would like to see is:
	-User: john-doe
		-Total number of operations.
		-Number of GET operations.
		-Number of PUT operations.
		-Number of DELETE operations.
		-If we can have this information per S3 path would be perfect as we might see what our users are doing:
			-Are they reading again and again a single file?
			-Are they overwriting again and again a single file?
	-Bucket: my-bucket
		-Total number of operations and the different users accessing the bucket.
		-Number of GET operations and the different users accessing the bucket.
		-Number of PUT operations and the different users accessing the bucket.
		-Number of DELETE operations and the different users accessing the bucket.
		-If we can have this information per S3 path would be perfect as we might see what our users are doing:
			-Are they reading again and again a single file?
			-Are they overwriting again and again a single file?


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 2 Tomas Petr 2021-02-16 17:59:32 UTC
for reference BZ for Dashboard to display this data:
Bug 1929358 - [cee/sd][RFE][dashboard] Display operation (GET, PUT, DELETE, ...) counters/trackers from RadosGW in the Ceph dashboard
https://bugzilla.redhat.com/show_bug.cgi?id=1929358

Comment 52 errata-xmlrpc 2023-12-13 15:18:34 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 7.0 Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:7780

Comment 53 Red Hat Bugzilla 2024-04-12 04:25:03 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days

Comment 64 Red Hat Bugzilla 2024-10-09 04:25:02 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days