Bug 1929346 - [cee/sd][RFE][RGW] Add operation (GET, PUT, DELETE, ...) counters/trackers in RadosGW per bucket and users
Summary: [cee/sd][RFE][RGW] Add operation (GET, PUT, DELETE, ...) counters/trackers i...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 4.2
Hardware: Unspecified
OS: Unspecified
medium
low
Target Milestone: ---
: 7.0
Assignee: Ali Maredia
QA Contact: Chaithra
Rivka Pollack
URL:
Whiteboard:
Depends On:
Blocks: 2237662
TreeView+ depends on / blocked
 
Reported: 2021-02-16 17:28 UTC by Tomas Petr
Modified: 2024-10-09 04:25 UTC (History)
17 users (show)

Fixed In Version: ceph-18.2.0-100.el9cp
Doc Type: Enhancement
Doc Text:
.Perf counters for S3 operations can now be sent Prometheus With this enhancement, you can send a new labeled counter to Prometheus by using the Ceph exporter daemon and is useful for common S3 operations, such as PUTs, which can be visualized per bucket or per user. Perf counters for S3 operations labeled by either the user or the bucket are emitted by using the `ceph counter dump` command.
Clone Of:
Environment:
Last Closed: 2023-12-13 15:18:34 UTC
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2023:7780 0 None None None 2023-12-13 15:18:40 UTC

Description Tomas Petr 2021-02-16 17:28:46 UTC 
Description of problem:
Add counters for client operations per users and buckets to be able monitor it via dashboard. 

To have RadosGW able store this information in counters/trackers and share this information with prometheus in order to be able to display it in the Ceph dashboard (a similar RFE will be opened to display this information).

What we would like to see is:
	-User: john-doe
		-Total number of operations.
		-Number of GET operations.
		-Number of PUT operations.
		-Number of DELETE operations.
		-If we can have this information per S3 path would be perfect as we might see what our users are doing:
			-Are they reading again and again a single file?
			-Are they overwriting again and again a single file?
	-Bucket: my-bucket
		-Total number of operations and the different users accessing the bucket.
		-Number of GET operations and the different users accessing the bucket.
		-Number of PUT operations and the different users accessing the bucket.
		-Number of DELETE operations and the different users accessing the bucket.
		-If we can have this information per S3 path would be perfect as we might see what our users are doing:
			-Are they reading again and again a single file?
			-Are they overwriting again and again a single file?


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 2 Tomas Petr 2021-02-16 17:59:32 UTC 
for reference BZ for Dashboard to display this data:
Bug 1929358 - [cee/sd][RFE][dashboard] Display operation (GET, PUT, DELETE, ...) counters/trackers from RadosGW in the Ceph dashboard
https://bugzilla.redhat.com/show_bug.cgi?id=1929358
Comment 52 errata-xmlrpc 2023-12-13 15:18:34 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 7.0 Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:7780
Comment 53 Red Hat Bugzilla 2024-04-12 04:25:03 UTC 
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days
Comment 64 Red Hat Bugzilla 2024-10-09 04:25:02 UTC 
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days
Note You need to log in before you can comment on or make changes to this bug.