Bug 1319330

Summary: [RFE] Change default OSD dir in OSP-d
Product: Red Hat OpenStack Reporter: Alexandre Marangone <amarango>
Component: rhosp-directorAssignee: Sébastien Han <shan>
Status: CLOSED CURRENTRELEASE QA Contact: Yogev Rabl <yrabl>
Severity: unspecified Docs Contact: Derek <dcadzow>
Priority: medium    
Version: unspecifiedCC: athomas, dbecker, dcadzow, ekuvaja, flucifre, gfidente, jcoufal, jomurphy, jschluet, mburns, mcornea, morazi, pgrist, rhel-osp-director-maint, sclewis, scohen, seb
Target Milestone: Upstream M3Keywords: FutureFeature, Reopened
Target Release: 10.0 (Newton)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Enhancement
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-12-16 16:50:42 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1387433, 1413723    

Description Alexandre Marangone 2016-03-18 21:08:15 UTC
Description of problem:
Currently the default OSD dir is set to /srv/data while Ceph expect all OSDs to be in /var/lib/ceph/osd. This isn't a big issue since Ceph will automatically create symlinks to /var/lib/ceph/osd if the OSDs are mounted elsewhere, but if there are no technical reason for putting OSDs in /srv/data, we should leave it default.

Comment 2 Mike Burns 2016-04-07 21:14:44 UTC
This bug did not make the OSP 8.0 release.  It is being deferred to OSP 10.

Comment 3 Erno Kuvaja 2016-05-11 11:36:04 UTC
Hi Angus,

I could try to drive this change via upstream getting TripleO providing sensible defaults to the deployment. If you are ok with that feel free to assign the bug to me and I'll start working on it.

Comment 4 Giulio Fidente 2016-05-12 14:58:50 UTC
this is set in a single file [1] but we'll need to figure what to do on upgrades

one approach could be to prevent puppet-ceph from changing these values on a running cluster

another approach could be to tell the user to feed via Heat parameter, at the time of the upgrade, their old default

1. https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/hieradata
/ceph.yaml

Comment 5 Stephen Gordon 2016-06-09 18:49:42 UTC
Bulk update to reflect scope of Red Hat OpenStack Platform 9 and Red Hat OpenStack Platform does not include this issue (No pm_ack+).

Comment 7 Federico Lucifredi 2016-08-04 16:26:33 UTC
Instead of cloning for 11, I will reopen and target to OSP-11.

Issue is lack of tracking of state for Ceph in Director... if we made the change in current architecture, on an upgrade this would be lost.

Moving to 11, where the new architecture kicks in and hopefully we can address this.

Comment 9 Erno Kuvaja 2016-08-10 14:29:46 UTC
default assignment as this is non-actionable. I don't see this as actionable for OPS 11 either.

Comment 11 seb 2016-10-20 16:38:44 UTC
Just looked into a fresh OSP10 deployment and this is what I'm getting:


$ sudo df -h | grep osd
Filesystem      Size  Used Avail Use% Mounted on
/dev/vdb1        55G   38M   55G   1% /var/lib/ceph/osd/ceph-0

So it seems that the default osd location is honoured so moving this one to verified.

Comment 12 Giulio Fidente 2016-10-20 21:23:49 UTC
(In reply to seb from comment #11)
> Just looked into a fresh OSP10 deployment and this is what I'm getting:
> 
> 
> $ sudo df -h | grep osd
> Filesystem      Size  Used Avail Use% Mounted on
> /dev/vdb1        55G   38M   55G   1% /var/lib/ceph/osd/ceph-0
> 
> So it seems that the default osd location is honoured so moving this one to
> verified.

that is a symlink though and it's actually always been created, not sure if it is enough to close the BZ

Comment 13 seb 2016-10-25 13:56:08 UTC
@Giulio, no this is not a symlink, I also checked that on a fresh OSP10 install.

Comment 14 Giulio Fidente 2016-10-25 14:05:20 UTC
It is a symlink for me, unless you override the default OSDs config via hiera.

  # sudo hiera ceph::profile::params::osds
  {"/srv/data"=>{}}

  # ls -l /var/lib/ceph/osd/
  total 0
  lrwxrwxrwx. 1 root root 9 Oct 25 13:49 ceph-0 -> /srv/data

Comment 15 seb 2016-10-25 14:48:42 UTC
Hum I might have done then, alright.

Comment 20 Derek 2016-12-12 19:11:40 UTC
OK, we still have it in the OSP 10 program for post-GA completion.