Bug 1482739

Summary: [RFE] RGW Bucket Index Trimming for MultisiteV2
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Matt Benjamin (redhat) <mbenjamin>
Component: RGWAssignee: Casey Bodley <cbodley>
Status: CLOSED ERRATA QA Contact: Vidushi Mishra <vimishra>
Severity: high Docs Contact:
Priority: medium    
Version: 3.0CC: anharris, cbodley, ceph-eng-bugs, jbrier, kbader, kdreyer, mbenjamin, owasserm, sweil, tchandra, vimishra
Target Milestone: rcKeywords: FutureFeature
Target Release: 3.1   
Hardware: All   
OS: All   
Whiteboard:
Fixed In Version: RHEL: ceph-12.2.5-13.el7cp Ubuntu: 12.2.5-4redhat1xenial Doc Type: Enhancement
Doc Text:
.Automated trimming of bucket index logs When multisite sync is used, all changes are logged in the bucket index. These logs can grow excessively large. They also are no longer needed once they have been processed by all peer zones. With this update of {product}, the bucket index logs are automatically trimmed and do not grow beyond a reasonable size.
Story Points: ---
Clone Of:
: 1573471 (view as bug list) Environment:
Last Closed: 2018-09-26 18:16:41 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1573471, 1584264    

Description Matt Benjamin (redhat) 2017-08-18 02:23:22 UTC
Multisite sync is based on logs of data and metadata changes, which will continue to grow over time. Log entries should be trimmed periodically once it can be proved that no other zone will need to read them.

https://trello.com/c/4IWMXSWa/14-data-metadata-log-and-bucket-index-trimming-for-multisitev2

Data Log and Metadata Log Trimming are both implemented in RHCS 3.0.  Bucket Index Trimming and Bucket Delete cleanup now being implemented, regargeting for 3.1.

Comment 2 Matt Benjamin (redhat) 2018-05-01 11:56:17 UTC
bucket index trimming is complete in rhcs 3.1 upstream baseline, splitting out bucket delete cleanup targeting 4.0

Comment 9 errata-xmlrpc 2018-09-26 18:16:41 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:2819