Bug 1350638

Summary:	[RADOS]:[UPGRADE]: Apparent data loss after upgrading from 1.3.2 to 2.0 using "setuser match path" config
Product:	[Red Hat Storage] Red Hat Ceph Storage	Reporter:	shylesh <shmohan>
Component:	RADOS	Assignee:	Samuel Just <sjust>
Status:	CLOSED ERRATA	QA Contact:	shylesh <shmohan>
Severity:	urgent	Docs Contact:
Priority:	unspecified
Version:	2.0	CC:	ceph-eng-bugs, ceph-qe-bugs, dzafman, hnallurv, kchai, kdreyer, ltrilety, vakulkar
Target Milestone:	rc
Target Release:	2.0
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:	RHEL: ceph-10.2.2-9.el7cp Ubuntu: ceph_10.2.2-7redhat1xenial	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2016-08-23 19:43:03 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Comment 2 Samuel Just 2016-06-28 15:41:00 UTC

We think this was due to me messing up the patch removing libradosstriper for https://bugzilla.redhat.com/show_bug.cgi?id=1339870 (there is no corresponding upstream bug).  The next build should have it fixed.

Comment 5 Vasu Kulkarni 2016-06-28 16:38:30 UTC

The upgrade process doesn't look right to me, a restart of process is not sufficient after upgrade there could be old osd process still running, also is this a reason to run everything as root/root instead of ceph/ceph?

the steps mentioned here are accurate: bz 1347395 which is yet to go into docs.

Comment 6 shylesh 2016-06-28 16:46:21 UTC

(In reply to Vasu Kulkarni from comment #5)
> The upgrade process doesn't look right to me, a restart of process is not
> sufficient after upgrade there could be old osd process still running, also
> is this a reason to run everything as root/root instead of ceph/ceph?
> 
> the steps mentioned here are accurate: bz 1347395 which is yet to go into
> docs.

@Vasu,

Upgrade is actually done by tejas, I think he followed the proper docs for upgrade. It might be my mistake in the description.

Comment 7 Vasu Kulkarni 2016-06-28 16:49:45 UTC

Thanks shylesh, the ll still shows root/root for /var/lib/ceph in your earlier comment

drwxr-xr-x. 3 root root 218 Jun 27 10:48 ceph-3

Comment 8 shylesh 2016-06-28 16:52:51 UTC

(In reply to Vasu Kulkarni from comment #7)
> Thanks shylesh, the ll still shows root/root for /var/lib/ceph in your
> earlier comment
> 
> drwxr-xr-x. 3 root root 218 Jun 27 10:48 ceph-3

@Vasu,

Yes that's the use case for "setuser match path = /var/lib/ceph/$type/$cluster-$id". Existing root owned dirs will remain as root and processes also runs as root. Any newly added osds after upgrade will run as ceph.

Comment 12 shylesh 2016-06-30 16:46:48 UTC

Verifid on RHEL7.2 ceph-common-10.2.2-9.el7cp.x86_64 and now rados tool works fine. Hence marking it as verified

Comment 13 Samuel Just 2016-07-13 14:36:08 UTC

*** Bug 1355958 has been marked as a duplicate of this bug. ***

Comment 15 errata-xmlrpc 2016-08-23 19:43:03 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2016-1755.html