Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use https://ibm-ceph.atlassian.net/ for all bug tracking management.

Bug 1489835

Summary: [ceph-container] - OSD not getting activated - entrypoint.sh: static: does not generate config
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Vasishta <vashastr>
Component: ContainerAssignee: Sébastien Han <shan>
Status: CLOSED NOTABUG QA Contact: Harish NV Rao <hnallurv>
Severity: high Docs Contact:
Priority: unspecified    
Version: 3.0CC: dang, hchen, jim.curtis, pprakash, seb
Target Milestone: rc   
Target Release: 3.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-09-15 13:12:06 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
File contains OSD service log snippet, docker service log snippet and ansible log
none
File contains journald logs of an osd serivce
none
File contains journald logs of an osd serivce none

Description Vasishta 2017-09-08 12:47:17 UTC 
Created attachment 1323733 [details]
File contains OSD service log snippet, docker service log snippet and ansible log

Description of problem:
After ansible playbook successfully completed running site-docker.yml, OSDs are not getting activated. 

Faced this issue while working on BZ 1458512
Cluster name used - 11

Version-Release number of selected component (if applicable):
ceph-3.0-rhel-7-docker-candidate-71465-20170804220045
ceph-ansible-3.0.0-0.1.rc6.el7cp.noarch

How reproducible:
Always (2/2)

Steps to Reproduce:
1.Configure ceph ansible to get a containerized ceph cluster up with container name with numbers
2.run ansible-playbook site-docker.yml

Actual results:
OSD not getting activated
(/entrypoint.sh: static: does not generate config)

Expected results:
OSD must get activated

Additional info:
1) Please let me know if I have missed anything
$ cat group_vars/osds.yml | egrep -v ^# | grep -v ^$
---
dummy:
devices:
  - /dev/sdb
  - /dev/sdc
  - /dev/sdd
ceph_osd_docker_prepare_env: -e CLUSTER={{ cluster }} -e OSD_JOURNAL_SIZE={{ journal_size }} -e OSD_FORCE_ZAP=1 -e OSD_FILESTORE=1
ceph_osd_docker_extra_env: -e CLUSTER={{ cluster }} -e CEPH_DAEMON=OSD_CEPH_DISK_ACTIVATE -e OSD_JOURNAL_SIZE={{ journal_size }} -e OSD_FILESTORE=1

2) expose_partions function from /usr/share/ceph-osd-run.sh has been copied into the attachment, where OSD_BLUESTORE_BLOCK_WAL is being set, it lead to a bit confusion.
Comment 2 seb 2017-09-08 13:53:39 UTC 
please edit /usr/share/ceph-osd-run.sh and add

-e DEBUG=verbose \

Then look at journald logs and write it here, thanks.
Comment 3 Vasishta 2017-09-08 14:13:05 UTC 
Created attachment 1323752 [details]
File contains journald logs of an osd serivce
Comment 4 seb 2017-09-08 14:23:47 UTC 
Also could you use the latest image available? Looks like ceph-3.0-rhel-7-docker-candidate-21213-20170908140758 is the latest.

Thanks!
Comment 5 Vasishta 2017-09-08 15:16:08 UTC 
Created attachment 1323772 [details]
File contains journald logs of an osd serivce

Hi Sebastien,

I upgraded only one OSD node, Here's the log snippet -
raise Error('%s does not exist' % args.path)
ceph-osd-run.sh[32644]: ceph_disk.main.Error: Error: /dev/sdb1 does not exist

Larger log snippet is in the attachment.

Regards,
Vasishata
Comment 6 seb 2017-09-13 15:40:13 UTC 
Please add osd_scenario: collocated 
Also leave ceph_osd_docker_extra_env empty and set ceph_osd_docker_prepare_env: -e OSD_JOURNAL_SIZE={{ journal_size }}

Thanks.
Comment 7 seb 2017-09-15 13:12:06 UTC 
I'm closing this since this was due to a misconfiguration.
We will address the doc in another BZ.