Bug 1333754 - Changing master zone procedure results in error
Summary: Changing master zone procedure results in error
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat
Component: RGW
Version: 2.0
Hardware: Unspecified
OS: Unspecified
Target Milestone: rc
: 2.0
Assignee: Casey Bodley
QA Contact: shilpa
Depends On:
TreeView+ depends on / blocked
Reported: 2016-05-06 10:27 UTC by shilpa
Modified: 2017-07-31 20:59 UTC (History)
8 users (show)

Fixed In Version: RHEL: ceph-10.2.1-1.el7cp Ubuntu: ceph_10.2.1-2redhat1xenial
Doc Type: Bug Fix
Doc Text:
Clone Of:
Last Closed: 2016-08-23 19:37:50 UTC
Target Upstream Version:

Attachments (Terms of Use)

System ID Private Priority Status Summary Last Updated
Ceph Project Bug Tracker 15828 0 None None None 2016-05-10 20:14:06 UTC
Red Hat Product Errata RHBA-2016:1755 0 normal SHIPPED_LIVE Red Hat Ceph Storage 2.0 bug fix and enhancement update 2016-08-23 23:23:52 UTC

Description shilpa 2016-05-06 10:27:53 UTC
Description of problem:
After changing the master zone, doing a period commit fails. 

Version-Release number of selected component (if applicable):

How reproducible:

Steps to Reproduce:
1. Configure us-1 as master zone with a multizone configuration with us-1 and us-2 as the zones.
2. Make us-2 as master. #radosgw-admin zone modify --rgw-zone=us-2 --master
3. Do a period update --commit and a radosgw restart on both the rgw nodes. 

Actual results:
Period commit throws an error:

# radosgw-admin period update --commit
request failed: (22) Invalid argument
Reason: Cannot commit period on zone 4f20d429-9e6c-4c0c-993b-7c2dd3f7d263, it must be sent to the period's master zone 8d3e4783-47e9-44b8-b772-07ad5888c028.

failed to commit period: (22) Invalid argument

get --staging command shows the period updated with us-2 as master. But commit throws error. Data fails to sync.

Additional info:

Logs in http://pastebin.test.redhat.com/371616

Comment 2 Casey Bodley 2016-05-10 20:14:07 UTC
Added upstream ticket http://tracker.ceph.com/issues/15828 and fixed in https://github.com/ceph/ceph/pull/9055.

Comment 3 Ken Dreyer (Red Hat) 2016-05-13 23:27:55 UTC
https://github.com/ceph/ceph/pull/9081 was merged to jewel and is present in v10.2.1.

Comment 6 shilpa 2016-07-14 07:57:12 UTC
Tested on 10.2.2-18. The procedure is:

On the rgw zone which has to be made primary:
1. radosgw-admin zone modify --rgw-zonegroup=us --rgw-zone=us-2 --access_key=secret --secret=secret --endpoints=http://rgw2:80 --default --master

2. radosgw-admin period update --commit

3. "radosgw-admin period get" should show the new master as us-2

4. Restart gateway

Comment 8 errata-xmlrpc 2016-08-23 19:37:50 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.