Bug 1563280 - Expose /var/run/ceph on baremetal for other tools (like collectd) to be able to query
Summary: Expose /var/run/ceph on baremetal for other tools (like collectd) to be able ...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat
Component: Ceph-Ansible
Version: 3.0
Hardware: x86_64
OS: Linux
medium
medium
Target Milestone: rc
: 3.1
Assignee: leseb
QA Contact: Vasishta
URL:
Whiteboard:
Depends On:
Blocks: 1578730 1558015
TreeView+ depends on / blocked
 
Reported: 2018-04-03 14:06 UTC by Giulio Fidente
Modified: 2019-08-27 05:18 UTC (History)
10 users (show)

Fixed In Version: ceph-ansible-3.1.0-0.1.beta8.el7cp
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-08-27 05:18:17 UTC
Target Upstream Version:

Attachments (Terms of Use)
Add an attachment (proposed patch, testcase, etc.)


Links
System ID Priority Status Summary Last Updated
Github ceph ceph-ansible pull 2520 None closed Expose /var/run/ceph 2020-07-21 02:44:53 UTC

Description Giulio Fidente 2018-04-03 14:06:44 UTC 
Would be useful to expose /var/run/ceph on the baremetal node hosting the Ceph containers for other tools, like collectd, to query for their status.
Comment 3 leseb 2018-04-12 13:42:43 UTC 
If you need this now, you can always use 'ceph_osd_docker_extra_env' and set:

ceph_osd_docker_extra_env: "-v /var/run/ceph:/var/run/ceph"
Comment 4 Giulio Fidente 2018-04-12 17:24:54 UTC 
(In reply to leseb from comment #3)
> If you need this now, you can always use 'ceph_osd_docker_extra_env' and set:
> 
> ceph_osd_docker_extra_env: "-v /var/run/ceph:/var/run/ceph"

thanks Seb!

maybe worth documenting how to use the workaround from Director; people can achieve the above by creating/using a custom environment file with the following contents:

parameter_defaults:
  CephAnsibleExtraConfig:
    ceph_osd_docker_extra_env: "-v /var/run/ceph:/var/run/ceph"
Comment 5 leseb 2018-06-04 03:35:44 UTC 
In v3.1.0beta8 and above.
Comment 6 Harish NV Rao 2018-06-04 12:27:40 UTC 
@Giulio, will you or Yogev be testing the fix for this? Please let me know.
Comment 7 Giulio Fidente 2018-06-04 13:07:54 UTC 
(In reply to Harish NV Rao from comment #6)
> @Giulio, will you or Yogev be testing the fix for this? Please let me know.

We could but verification is relatively simple without OSP.

Basically you'd want to deploy Ceph in containers and then see if on the baremetal node hosting the containers you have the Ceph sockets in /var/run/ceph.

For example, colocate some OSDs and/or MONs or MGRs on a single node and then attach the list of files you see in /var/run/ceph on the baremetal node.

Do you think you could test this?
Comment 8 subhash 2018-07-04 09:44:53 UTC 
Verified with version ansible-2.4.5.0-1.el7ae.noarch ,
ceph-ansible-3.1.0-0.1.rc9.el7cp.noarch

Deployed ceph in containers by collocating some daemons

output on the baremetal node

[ubuntu@magna028 ~]$ ll /var/run/ceph/
total 0
srwxr-xr-x. 1 167 167 0 Jul  4 09:03 ceph-mds.magna028.asok
srwxr-xr-x. 1 167 167 0 Jul  4 09:00 ceph-osd.3.asok
srwxr-xr-x. 1 167 167 0 Jul  3 09:03 ceph-osd.4.asok
srwxr-xr-x. 1 167 167 0 Jul  4 09:00 ceph-osd.5.asok
srwxr-xr-x. 1 167 167 0 Jul  3 09:03 ceph-osd.6.asok
srwxr-xr-x. 1 167 167 0 Jul  4 09:00 ceph-osd.7.asok
srwxr-xr-x. 1 167 167 0 Jul  3 09:03 ceph-osd.8.asok


output inside the osd container

[ubuntu@magna028 ~]$ sudo docker exec ceph-osd-magna028-sdc ls /var/run/ceph/
ceph-mds.magna028.asok
ceph-osd.3.asok
ceph-osd.4.asok
ceph-osd.5.asok
ceph-osd.6.asok
ceph-osd.7.asok
ceph-osd.8.asok

Ceph sockets are available on baremetal node hosting the containers,Hence moving to verfied state
Note You need to log in before you can comment on or make changes to this bug.