Bug 1733577

Summary: [RFE] Migrate an RHCS4 cluster deployed by director from filestore to bluestore
Product: Red Hat OpenStack Reporter: John Fulton <johfulto>
Component: openstack-tripleo-heat-templatesAssignee: Giulio Fidente <gfidente>
Status: CLOSED ERRATA QA Contact: Yogev Rabl <yrabl>
Severity: high Docs Contact:
Priority: high    
Version: 16.0 (Train)CC: alfrgarc, fpantano, gabrioux, gcharot, gfidente, gregraka, jamsmith, mburns, moddi, msufiyan, ndeevy, nwolf, pasik, ravsingh, scohen, spower, sputhenp
Target Milestone: z2Keywords: FutureFeature, Triaged
Target Release: 16.1 (Train on RHEL 8.2)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-tripleo-heat-templates-11.3.2-0.20200616081533.396affd.el8ost Doc Type: Known Issue
Doc Text:
A known issue causes the migration of Ceph OSDs from FileStore to BlueStore to fail. In use cases where the `osd_objectstore` parameter was not set explicitly when you deployed Red Hat OpenStack Platform 13 with Red Hat Ceph Storage 3, the migration exits without converting any OSDs and falsely reports that the OSDs are already using BlueStore. For more information about the known issue, see https://bugzilla.redhat.com/show_bug.cgi?id=1875777 + As a workaround, perform the following steps: + . Include the following content in an environment file: + ``` parameter_defaults: CephAnsibleExtraConfig: osd_objectstore: filestore ``` . Perform a stack update with the `overcloud deploy --stack-only` command, and include the new or existing environment file that contains the `osd_objectstore` parameter. In the following example, this environment file is `<osd_objectstore_environment_file>`. Also include any other environment files that you included during the converge step of the upgrade: + ``` $ openstack overcloud deploy --stack-only \ -e <osd_objectstore_environment_file> \ -e <converge_step_environment_files> ``` . Proceed with the FileStore to BlueStore migration by using the existing documentation. See https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/16.1/html/framework_for_upgrades_13_to_16.1/OSD-migration-from-filestore-to-bluestore + *Result:* The FileStore to BlueStore playbook triggers the conversion process, and removes and re-creates the OSDs successfully.
Story Points: ---
Clone Of:
: 1738236 (view as bug list) Environment:
Last Closed: 2020-10-28 15:36:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1697511, 1729267, 1738576, 1756366, 1756371, 1790479, 1844591, 1854973    
Bug Blocks: 1738236    

Description John Fulton 2019-07-26 15:16:10 UTC
Customers who have completed the process enabled by RFE 1697511 will be running OSP16 and RHCS4 but with the filestore ceph backend. They will then wish to migrate to the bluestore ceph backend. This is an RFE to track OSPd's ability to manage that migration. This RFE will ultimately depend on a ceph-ansible playbook to perform the migration.

Comment 4 John Fulton 2019-07-26 16:00:15 UTC
Since tripleo can now generate an inventory which is compatible with ceph-ansible [0] and since all ceph-ansible runs in OSP16 will already use the tripleo inventory [1], I think we should be able to test and then document the following rough process:

1. tripleo-ansible-inventory --static-yaml-inventory ~/inventory.yaml [2]
2. ansible-playbook -i ~/inventory.yaml ... /usr/share/ceph-ansible/infrastructure-playbooks/filestore_to_bluestore.yml

making this almost a test-only RFE.

[0] https://review.opendev.org/#/c/663466 
[1] https://github.com/openstack/tripleo-heat-templates/commit/f86635803793c006210495b0c2fe8c34bf301f6c
[2] https://www.redhat.com/en/blog/greater-control-red-hat-openstack-platform-deployment-ansible-integration

Comment 12 Giulio Fidente 2020-06-03 16:09:48 UTC
needs more work in tht to be able to trigger the playbook from director

Comment 22 Giulio Fidente 2020-07-03 16:52:59 UTC
*** Bug 1853721 has been marked as a duplicate of this bug. ***

Comment 31 errata-xmlrpc 2020-10-28 15:36:47 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 16.1 bug fix and enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2020:4284

Comment 32 John Fulton 2021-01-04 14:43:06 UTC
*** Bug 1911669 has been marked as a duplicate of this bug. ***