Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1238498

Summary:	[RFE] ephemeral storage option exposure for user
Product:	Red Hat OpenStack	Reporter:	arkady kanevsky <arkady_kanevsky>
Component:	rhosp-director	Assignee:	Alan Bishop <abishop>
Status:	CLOSED DEFERRED	QA Contact:	Tzach Shefi <tshefi>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	7.0 (Kilo)	CC:	abishop, arkady_kanevsky, cdevine, christopher_dearborn, hbrock, ichute, jcoufal, John_walsh, kbasil, kholtz, kurt_hey, mandreou, mburns, morazi, pgrist, rajini.karthik, rhel-osp-director-maint, rhos-maint, rsussman, sclewis, scohen, srevivo
Target Milestone:	---	Keywords:	FutureFeature, ZStream
Target Release:	---	Flags:	scohen: needinfo+
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Enhancement
Doc Text:		Story Points:	---
Clone Of:
Clones:	1303814 (view as bug list)		Environment:
Last Closed:	2019-07-03 23:56:52 UTC	Type:	Feature Request
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1303814, 1476900, 1519552

Description arkady kanevsky 2015-07-02 01:16:10 UTC

Description of problem:
As a user I need an ability to specify which option for ephemeral storage for the deployment I want. The two options to expose are: local nova node storage, on backend cinder storage. For the later option it includes all backend storage of the deployment. For example, Ceph block storage and Dell EQL. 

It will be good to document to only use single type of backend, or just a single pool on a backend storage even if multiple backend storage exist.
But that is a separate request.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 3 arkady kanevsky 2015-07-02 01:18:45 UTC

Mike,
Let me know if this can be done for GA.


Also,
pleased clone it for OSP director & RDO manager.

Comment 6 Marios Andreou 2015-09-15 15:53:10 UTC

With respect to having instance ephemeral disk on the local nova node or on ceph rbd, we already have those covered and i sanity checked today. One thing still not clear to me is "backend cinder storage" for instance ephemeral, does this just mean/refer to 'booting from volume'? If so I haven't tested/know how well we support that.

For vm ephemeral on local nova node you just deploy without any ceph-storage nodes defined (or if you do, making sure your storage environment doesn't set the nova rbdbackend to true like [1], false by default). I deployed a simple 1 control 1 compute, no ceph:

openstack overcloud deploy --templates --control-scale 1 --compute-scale 1

Then I deployed an instance in the overcloud can see the instance ephemeral disk on the local storage like:

[root@overcloud-compute-0 ~]# ls -l /var/lib/nova/instances/95dcdd02-d98a-4096-b2bc-81c65acba967
total 25784
-rw-rw----. 1 qemu qemu 40025 Sep 15 10:33 console.log
-rw-r--r--. 1 qemu qemu 26411008 Sep 15 11:46 disk
-rw-r--r--. 1 nova nova 79 Sep 15 10:28 disk.info
-rw-r--r--. 1 nova nova 2504 Sep 15 10:29 libvirt.xml

Then I deleted this and deployed with cephnodes and using the storage environment at [1]

openstack overcloud deploy --templates --ntp-server 0.europe.pool.ntp.org --control-scale 3 --compute-scale 2 --ceph-storage-scale 2 -e /usr/share/openstack-tripleo-heat-templates/environments/storage-environment.yaml

Launch tenant vm instance, the ephemeral disk is no longer created on the nova compute. The compute gets the ceph config and the relevant options are set in nova.conf

[1] https://github.com/openstack/tripleo-heat-templates/blob/master/environments/storage-environment.yaml#L15

Comment 7 Mike Burns 2015-11-06 20:30:12 UTC

(In reply to marios from comment #6)
> With respect to having instance ephemeral disk on the local nova node or on
> ceph rbd, we already have those covered and i sanity checked today. One
> thing still not clear to me is "backend cinder storage" for instance
> ephemeral, does this just mean/refer to 'booting from volume'? If so I
> haven't tested/know how well we support that.
> 
Arkady, can you clarify marios's question?

I think you're looking for using the cinder for storage of the ephemeral disks, so by extension putting ephemeral on something like Equalogic or Compellent.

Comment 8 arkady kanevsky 2015-11-23 15:29:45 UTC

Answer the question.
The ask is for OOO API (and UI) to expose to user an option to use compute local disks for ephemeral storage or use cinder storage for ephemeral.
This covers all user activities once deployment of OpenSTack is done.
That include boot from image and boot from volume and boot from clone and so on.

There is related BZ that asks for support for specific cinder backend for multi-back end cinder environments. That is, when you have multiple shared cinder backends, e.g. ceph, Dell PS (EQL), Dell SC (CMPl), NFS (NetApp), one can specify which one to use for VM ephemeral storage deployment.

Comment 9 arkady kanevsky 2015-12-07 14:42:50 UTC

changing status

Comment 10 Karl Hastings 2016-07-22 18:41:11 UTC

Updating Target Release since this was bumped to OSP 10 in April.

Comment 12 Sean Merrow 2016-12-08 16:28:08 UTC

since it is being moved to osp 11, removing the blocker for delljs7.0 tracker

Comment 14 Sean Merrow 2016-12-09 16:18:15 UTC

updating dell and epm trackers for OSP 12 since target has been updated.

Comment 17 Sean Merrow 2017-03-29 17:42:25 UTC

Arkady,

This one will get bumped to OSP13 unless this is something Dell is developing. Is there a method for prioritizing all the Dell/partner requests - is this truly urgent?

This goes back to my recent email to you about which RFEs are the highest priority that require Red Hat to develop/work on.

Thanks,
Sean

Comment 19 arkady kanevsky 2017-07-03 20:04:13 UTC

OSP13 should be fine.
What that means that for non-Ceph storage one must use local ephemeral storage on nova nodes. But we are still missing how to setup ephemeral to use remote storage like Dell SC. Second part is to expose it in TripleO and OSP director.
It is NOT Ceph or NFS.
Even if we have a way to configure nova to use it we still need to be able to configure and manage it thru OSPd.

Comment 20 Alan Bishop 2017-10-27 14:27:41 UTC

Here's some info to consider when planning for this. The feature is conceptually similar to Glance using Cinder for its backend. This means there are (at least) 4 pieces to the puzzle:

1) Cinder work to allow Nova to create/delete volumes
2) Nova work to interface with Cinder
3) TripleO work to deploy the feature (probably minor stuff to configure the Nova settings)
4) UI work

I did some research and found there's quite a bit of upstream history for this feature [1], [2]. Apparently John Griffith (cinder core) has expressed interest in working on the feature, and there are notes about building a spec and plan for Queens, but I found just a small mention in the Denver PTG notes [3].

[1] https://blueprints.launchpad.net/nova/+spec/nova-ephemeral-cinder
[2] http://lists.openstack.org/pipermail/openstack-dev/2017-May/117012.html
[3] https://etherpad.openstack.org/p/cinder-ptg-queens (see L273)

Comment 27 arkady kanevsky 2019-07-03 23:56:52 UTC

This has been around for long time.
I will close it and will create a new one if/when there is some progress on it upstream.

Comment 28 arkady kanevsky 2019-07-03 23:57:25 UTC

This has been around for long time.
I will close it and will create a new one if/when there is some progress on it upstream.