Bug 1389845

Summary: [RFE] Set a default quota on the bucket index
Product: Red Hat Ceph Storage Reporter: Neil Levine <nlevine>
Component: RGWAssignee: Matt Benjamin (redhat) <mbenjamin>
Status: CLOSED NOTABUG QA Contact: ceph-qe-bugs <ceph-qe-bugs>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 2.0CC: cbodley, ceph-eng-bugs, dang, kbader, kdreyer, mbenjamin, owasserm, sweil, uboppana, vakulkar, yehuda
Target Milestone: rcKeywords: FutureFeature
Target Release: 2.2   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-11-03 21:47:00 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Neil Levine 2016-10-28 21:48:06 UTC 
Large bucket indexes represent a scaling issue if customer don't shard the bucket ahead of time. If the bucket index grows too large, performance can suffer.

To ensure customers don't create too large a bucket index, we should set a default quota of 100k by default. This assumes the customer is not sharding by default. 

If they do shard, we can recommend (in the docs) that they set the bucket index quota to be 100k * the number of shards. However, the customer will explicitly have to change the default cap to do.
Comment 3 Daniel Gryniewicz 2016-10-31 17:45:12 UTC 
Why not just have a quota of 100k * #shards in code, and be done?  Is it really a good idea to add another "shoot yourself in the foot" option to the conf file?
Comment 5 Matt Benjamin (redhat) 2016-11-01 18:36:37 UTC 
PR for this issue in https://github.com/ceph/ceph/pull/11711
Comment 10 Uday Boppana 2016-11-03 17:56:59 UTC 
The combination of 
https://bugzilla.redhat.com/show_bug.cgi?id=1391500
and 
https://bugzilla.redhat.com/show_bug.cgi?id=1391650

cover the functionality that this BZ was trying to accomplish for 2.1 for both new and existing installs.