Bug 1238807

Summary:	the name/type of devices to use for Ceph on the OSDs nodes should support non-homogeneous disk topologies across the nodes
Product:	Red Hat OpenStack	Reporter:	Giulio Fidente <gfidente>
Component:	openstack-tripleo-heat-templates	Assignee:	Giulio Fidente <gfidente>
Status:	CLOSED ERRATA	QA Contact:	Yogev Rabl <yrabl>
Severity:	unspecified	Docs Contact:
Priority:	urgent
Version:	8.0 (Liberty)	CC:	cylopez, dprince, hbrock, jdonohue, kprabhak, ltoscano, mburns, mcornea, mlopes, morazi, ohochman, rhel-osp-director-maint, sclewis
Target Milestone:	ga	Keywords:	Triaged, ZStream
Target Release:	8.0 (Liberty)
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	openstack-tripleo-heat-templates-0.8.7-5.el7ost	Doc Type:	Enhancement
Doc Text:	This enhancement enables the distribution of per-node hieradata, matching the nodes from their UUID (as reported by 'dmidecode'). This allows you to scale CephStorage across nodes equipped with a different number/type of disks. As a result, CephStorage nodes can now be configured with non-homogeneous disk topologies. This is done by provisioning a different configuration hash for the ceph::profile::params::osds parameter.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2016-04-07 21:37:58 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1236143
Bug Blocks:	1191185, 1243520

Description Giulio Fidente 2015-07-02 16:23:08 UTC

Description of problem:
currently the name/type of devices usable by Ceph on the OSDs nodes resides in a hieradata file [1] and defaults to /srv/data

this can be edited into a hash, like [2], but it can't be passed as parameter to heat directly; we should probably make it a parameter instead and remove it from hieradata

1. https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/hieradata/ceph.yaml#L6

2. https://github.com/stackforge/puppet-ceph/blob/master/examples/nodes/first.yaml

Comment 6 Mike Burns 2015-08-31 19:01:07 UTC

patch 211935 superseded by 

https://review.openstack.org/#/c/215013/
and
https://review.openstack.org/#/c/215116/

Comment 8 Dan Prince 2015-09-21 20:12:48 UTC

The commit message here describes nicely how to test this:

https://review.openstack.org/#/c/215599/3

If you create a custom environment as described in that commit message it should allow you to override the Ceph storage node device on each node.

Comment 9 Karthik Prabhakar 2015-09-21 20:20:42 UTC

Does this include the ability to specify the name of a journal device as well (especially when the journal needs to be on a different device from the Ceph data disk - for e.g., when one or more SSD's need to be used for journal)?

Comment 11 Luigi Toscano 2015-09-25 18:39:54 UTC

It is not possible to set specific values on Ceph nodes; the new upstream patch https://review.openstack.org/#/c/215599/ (found after a bit of debugging) addresses this problem. Moving to ASSIGNED for now.

Comment 16 Yogev Rabl 2016-03-03 11:23:45 UTC

verified on 
openstack-tripleo-heat-templates-0.8.8-2.el7ost.noarch

Comment 18 errata-xmlrpc 2016-04-07 21:37:58 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHEA-2016-0604.html