Created attachment 1663019 [details] ansible.log from the deployment attempt Description of problem: Following instructions: https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/16.0/html/integrating_an_overcloud_with_an_existing_red_hat_ceph_cluster/index Deployment fails with: "failed: [overcloud-novacompute-0 -> 192.168.200.121] (item={'caps': {'mgr': 'allow *', 'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}, 'key': 'AQBqbcRdoQJwEhAA1dKnpQK6sT53EV0F12TFZA', 'mode': '0600', 'name': 'client.openstack'}) => changed=false ", " msg: path /etc/ceph/ceph.client.openstack.keyring does not exist", " path: /etc/ceph/ceph.client.openstack.keyring", Attaching ansible.log.gz Version-Release number of selected component (if applicable): How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
Please supply your complete heat templates, ceph-ansible version, and ceph container version. I'll set a needinfo in the bug. I don't want to close it for lack of information. I want to find what went wrong and help you get this working.
I was able to determine which ceph container you're using based on the ansible log: "ceph-container-common : pulling director16.ctlplane.homelab.net:8787/rhceph/rhceph-4-rhel8:4-14 image -- 24.74s", If you can it would make things easier if you could supply the isolated ceph-ansible log. You provided the config-download ansible log but this might be a ceph-ansible bug so I'd like to get the clean ceph-ansible log. The path is indicated in the ansible log at: [fultonj@runcible bz1802815]$ grep immediate\ log ansible.log 2020-02-13 17:47:43,423 p=256064 u=mistral | TASK [tripleo-ceph-run-ansible : run ceph-ansible (immediate log at /var/lib/mistral/overcloud/ceph-ansible/ceph_ansible_command.log)] *** [fultonj@runcible bz1802815]$ One thing I definitely need though is the version of ceph-ansible you're using: In summary I'm requesting the following from the undercloud: - /var/lib/mistral/overcloud/ceph-ansible/ceph_ansible_command.log - the output of 'rpm -q ceph-ansible' Thanks.
(In reply to John Fulton from comment #2) > In summary I'm requesting the following from the undercloud: > > - /var/lib/mistral/overcloud/ceph-ansible/ceph_ansible_command.log > - the output of 'rpm -q ceph-ansible' and your tripleo heat templates
Created attachment 1663185 [details] Templates and deployment script I removed most of the key from the containers yaml file for the BZ.
Created attachment 1663186 [details] ceph_ansible_command.log
I've updated the requested files. (undercloud) [stack@director16 ~]$ rpm -q ceph-ansible ceph-ansible-4.0.14-1.el8cp.noarch (undercloud) [stack@director16 ~]$ Please let me know if you need anything else. I will keep this deployment in the current state until you don't need anything else.
Created attachment 1663520 [details] Logs requested by Giulio
Created attachment 1663523 [details] Including the file I missed because I apparently didn't read the whole e-mail first. Sorry!
Darin, The THT had an invalid key as input in. Here's the environment file which was attached to the bug: [fultonj@runcible ceph-ansible]$ cat custom-ceph-external.yaml parameter_defaults: CephClusterFSID: aed38a87-94c5-4794-910a-3b4b9a1a0f51 CephClientKey: AQBqbcRdoQJwEhAA1dKnpQK6sT53EV0F12TFZA CephExternalMonHost: 172.16.210.50,172.16.210.60,172.16.210.70 GnocchiRbdPoolName: metrics [fultonj@runcible ceph-ansible]$ As Dimitri pointed out, the keyring doesn't have 40 characters and doesn't ended with '=='. As per the templates "The Ceph client key. Can be created with ceph-authtool --gen-print-key.": https://github.com/openstack/tripleo-heat-templates/blob/stable/train/deployment/ceph-ansible/ceph-base.yaml#L129-L132
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2020:2114