Bug 1322551

Summary: OSDs on 7.1 are not starting after ceph-deploy installation.
Product: Red Hat Ceph Storage Reporter: Warren <wusui>
Component: RADOSAssignee: Alfredo Deza <adeza>
Status: CLOSED NOTABUG QA Contact: ceph-qe-bugs <ceph-qe-bugs>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 1.3.2CC: ceph-eng-bugs, dzafman, gmeno, kchai, mlawrenc, wusui
Target Milestone: rc   
Target Release: 1.3.3   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-05-23 16:52:06 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Warren 2016-03-30 17:35:38 UTC
Description of problem:
I need to manually start OSDs after installation to bring a cluster up

Version-Release number of selected component (if applicable):
RHEL 7.1, Ceph 1.3

How reproducible:
100% of the time.

Steps to Reproduce:
Bring up a ceph cluster using ceph-deploy
run ceph osd tree after adding the OSDs

Actual results:
All the OSDs are marked down

Expected results:
OSDs should not be down.

Additional info:
Run:
sudo service ceph -a start osd
after that and the cluster comes up fine.

Comment 1 Warren 2016-03-30 17:36:20 UTC
This may also be the problem seen in 1320574

Comment 3 Warren 2016-03-31 00:17:38 UTC
Upon further review, the following does not seem to start an osd:

ceph-deploy disk zap magna037:sdb
ceph-deploy osd create magna037:sdb

But the following does start the osd:

ceph-deploy disk zap magna037:sdb
ceph-deploy osd prepare magna037:sdb
ceph-deploy osd activate magna037:sdb1:sdb2

Comment 4 Kefu Chai 2016-03-31 12:09:02 UTC
it sounds like an issue in ceph-deploy.

Comment 5 Alfredo Deza 2016-04-01 16:18:51 UTC
@Warren, I think the ceph-deploy behavior on 7.N is expected. "create" is not used and "prepare + activate" is what our docs say:

https://access.redhat.com/documentation/en/red-hat-ceph-storage/version-1.2.3/red-hat-ceph-storage-123-installation-guide-for-rhel-x86-64/

Comment 6 Christina Meno 2016-04-09 13:40:47 UTC
Warren, 

Do Alfredo's suggestions in https://bugzilla.redhat.com/show_bug.cgi?id=1322551#c5 resolve your issue?

Comment 8 Warren 2016-05-23 16:52:06 UTC
The prepare and activate combination works.