Bug 1760941

Summary: [RFE] Support multiple runs of ceph-ansible for multiple external ceph clusters
Product: Red Hat OpenStack Reporter: John Fulton <johfulto>
Component: openstack-tripleo-heat-templatesAssignee: John Fulton <johfulto>
Status: CLOSED ERRATA QA Contact: Yogev Rabl <yrabl>
Severity: high Docs Contact:
Priority: high    
Version: 16.0 (Train)CC: dcadzow, gcharot, gfidente, mburns, nwolf, pgrist, scohen
Target Milestone: betaKeywords: FutureFeature, Triaged
Target Release: 16.1 (Train on RHEL 8.2)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: docs-accepted
Fixed In Version: openstack-tripleo-heat-templates-11.3.2-0.20200305103702.27dad4f.el8ost.noarch.rpm, tripleo-ansible-0.4.2-0.20200310155030.00cb5fc.el8ost.noarch.rpm Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-07-29 07:49:26 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1767581, 1787639    
Bug Blocks: 1598716, 1789430, 1802772    

Description John Fulton 2019-10-11 19:00:07 UTC
This RFE tracks support for the following pattern which is relevant to running multiple instances of Glance accross multiple edge sites:

1. deploy central site with internal ceph1 and glance1 with rbd backend ceph1
2. deploy edge site with internal ceph2 and glance2 with rbd backend ceph2
3. deploy edge site with internal ceph3 and glance3 with rbd backend ceph3
4. deploy edge site with internal cephN and glanceN with rbd backend cephN
5. update central site with internal ceph1, external ceph2, ceph3, ..., cephN and glance1 with rbd backends ceph1, ceph2, ceph3, ..., cephN

Steps 1-4 are already possible through split control plane deployments [0], but step 5 is not possible because a single stack only deals with a single ceph cluster. This RFE is focussed only on step 5's support for multiple external ceph clusters in a single stack update (internal ceph1, external ceph2, ceph3, ..., cephN). Though glance supports multiple backends [1], a separate RFE could track enabling TripleO to configure them (glance1 with rbd backends ceph1, ceph2, ceph3, ..., cephN). More details on configuring multiple external Ceph backends is filed in an upstream Tripleo Blueprint [2].

During step 5 we should support (and document) which ansible tags to pass when using config-download in order to minimize change so that the central stack update minimizes service restarts.

[0] https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/distributed_compute_node.html

[1] https://docs.openstack.org/glance/rocky/admin/multistores.html

[2] https://blueprints.launchpad.net/tripleo/+spec/multiple-external-ceph

Comment 4 John Fulton 2019-11-25 16:07:20 UTC
(In reply to John Fulton from comment #0)
> During step 5 we should support (and document) which ansible tags to pass
> when using config-download in order to minimize change so that the central
> stack update minimizes service restarts.

tracked in https://bugzilla.redhat.com/show_bug.cgi?id=1767581

The idea is that we'd have:

 openstack overcloud deploy --config-download-args "--skip-tags something"

for the central stack update

Comment 7 John Fulton 2020-03-05 19:10:04 UTC
The changes merged in THT + tripleo-ansible:

 https://review.opendev.org/#/q/status:merged+topic:multiple-external-ceph-train

I'm changing the component to THT since that's what one of the fixed-ins will be.

Comment 11 Yogev Rabl 2020-06-04 13:29:03 UTC
Verified for OSP 16.1

Comment 15 errata-xmlrpc 2020-07-29 07:49:26 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:3148