Bug 1477300

Summary:	[RFE] dynamic bucket sharding
Product:	[Red Hat Storage] Red Hat Ceph Storage	Reporter:	Matt Benjamin (redhat) <mbenjamin>
Component:	RGW	Assignee:	Orit Wasserman <owasserm>
Status:	CLOSED ERRATA	QA Contact:	Vidushi Mishra <vimishra>
Severity:	high	Docs Contact:	Erin Donnelly <edonnell>
Priority:	high
Version:	3.0	CC:	anharris, cbodley, ceph-eng-bugs, ceph-qe-bugs, edonnell, hnallurv, kbader, kdreyer, mbenjamin, owasserm, sweil, uboppana
Target Milestone:	rc	Keywords:	FutureFeature
Target Release:	3.0
Hardware:	All
OS:	All
Whiteboard:
Fixed In Version:	RHEL: ceph-12.1.4-1.el7cp Ubuntu: ceph_12.1.4-2redhat1xenial	Doc Type:	Enhancement
Doc Text:	.Support for dynamic bucket resharding The Ceph Object Gateway now supports the `rgw_dynamic_resharding` parameter. The process for dynamic bucket resharding periodically checks all the Ceph Object Gateway buckets and detects buckets that require resharding. If a bucket has grown larger than specified by the `rgw_max_objs_per_shard` parameter, the Ceph Object Gateway reshards the bucket dynamically in the background. For details, see the link:https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/3/html-single/object_gateway_guide_for_red_hat_enterprise_linux/#resharding-bucket-index-rhcs3[Dynamic Bucket Index Resharding in RHCS 3] section in the Object Gateway Guide for Red Hat Enterprise Linux. Note that dynamic bucket resharding is disabled in multi-site configuration.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2017-12-05 23:38:03 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1494421

Description Matt Benjamin (redhat) 2017-08-01 16:46:38 UTC

Provide a mechanism to dynamically re-shard buckets which have exceeded a configurable size threshold.

In this version:

1. object operations on buckets being resharded are blocked until completion
2. bucket shard count can expand but not shrink

Comment 2 Matt Benjamin (redhat) 2017-08-01 21:23:43 UTC

upstream PR: https://github.com/ceph/ceph/pull/11230

Comment 3 Ken Dreyer (Red Hat) 2017-08-02 16:12:42 UTC

Matt, PR 11230 went into Jewel back in https://github.com/ceph/ceph/pull/13341 (v10.2.6), so that has been in the product for a while now.

Is there another PR for this BZ? I'm wondering if http://tracker.ceph.com/issues/17550 does not really cover dynamic resharding?

Comment 4 Orit Wasserman 2017-08-03 08:45:14 UTC

(In reply to Ken Dreyer (Red Hat) from comment #3)
> Matt, PR 11230 went into Jewel back in
> https://github.com/ceph/ceph/pull/13341 (v10.2.6), so that has been in the
> product for a while now.
> 
> Is there another PR for this BZ? I'm wondering if
> http://tracker.ceph.com/issues/17550 does not really cover dynamic
> resharding?

Ken you are correct that was the offline resharding pr.
This is the dynamic resharding pr:
https://github.com/ceph/ceph/pull/15493

Comment 5 Ken Dreyer (Red Hat) 2017-08-16 21:20:13 UTC

On ceph-devel:

On Tue, Aug 8, 2017 at 11:11 AM, Matt Benjamin <mbenjami> wrote:
> I think dynamic resharding bugs are going
> to take longer than 1 day to resolve, so will need to follow the .0.

We need links to these bugs.

Comment 14 errata-xmlrpc 2017-12-05 23:38:03 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:3387