Red Hat Bugzilla – Bug 1386617
[ceph-iscsi-ansible]: gateways cannot be configured if cluster name is other than ceph
Last modified: 2016-11-16 04:44:22 EST
Description of problem: I have created a ceph cluster named "iscsi1". The task to sync the admin keyring fails, since its looking for the "ceph.client.admin.keyring". the keyring should be "<cluster>.client.admin.keyring" ll /etc/ceph/ total 12 -rw-------. 1 ceph ceph 63 Oct 19 01:57 iscsi1.client.admin.keyring -rw-r--r--. 1 ceph ceph 803 Oct 19 01:57 iscsi1.conf -rwxr-xr-x. 1 root root 92 Oct 12 12:40 rbdmap TASK: [ceph-iscsi-gw | sync the admin keyring from the seed monitor to each gateway node] *** failed: [havoc -> harvard] => {"cmd": "rsync --delay-updates -F --compress --archive --rsh 'ssh -S none -o StrictHostKeyChecking=no' --out-format='<<CHANGED>>%i %n%L' \"/etc/ceph/ceph.client.admin.keyring\" \"root@havoc:/etc/ceph/ceph.client.admin.keyring\"", "failed": true, "rc": 23} msg: rsync: link_stat "/etc/ceph/ceph.client.admin.keyring" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1052) [sender=3.0.9] failed: [mustang -> harvard] => {"cmd": "rsync --delay-updates -F --compress --archive --rsh 'ssh -S none -o StrictHostKeyChecking=no' --out-format='<<CHANGED>>%i %n%L' \"/etc/ceph/ceph.client.admin.keyring\" \"root@mustang:/etc/ceph/ceph.client.admin.keyring\"", "failed": true, "rc": 23} msg: rsync: link_stat "/etc/ceph/ceph.client.admin.keyring" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1052) [sender=3.0.9] failed: [magna086.ceph.redhat.com -> harvard] => {"cmd": "rsync --delay-updates -F --compress --archive --rsh 'ssh -S none -o StrictHostKeyChecking=no' --out-format='<<CHANGED>>%i %n%L' \"/etc/ceph/ceph.client.admin.keyring\" \"root@magna086.ceph.redhat.com:/etc/ceph/ceph.client.admin.keyring\"", "failed": true, "rc": 23} msg: rsync: link_stat "/etc/ceph/ceph.client.admin.keyring" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1052) [sender=3.0.9] failed: [magna080.ceph.redhat.com -> harvard] => {"cmd": "rsync --delay-updates -F --compress --archive --rsh 'ssh -S none -o StrictHostKeyChecking=no' --out-format='<<CHANGED>>%i %n%L' \"/etc/ceph/ceph.client.admin.keyring\" \"root@magna080.ceph.redhat.com:/etc/ceph/ceph.client.admin.keyring\"", "failed": true, "rc": 23} msg: rsync: link_stat "/etc/ceph/ceph.client.admin.keyring" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1052) [sender=3.0.9] FATAL: all hosts have already failed -- aborting We have a provision to support different names for clusters from Ceph 2.0 onwards. Version-Release number of selected component (if applicable): ceph-ansible-1.0.5-36.el7scon.noarch ceph-iscsi-ansible-1.2-1.el7scon.noarch How reproducible: Always Steps to Reproduce: 1. on a cluster which has a user defined name, try to create the iscsi gateways
Changing the cluster name not only impacts the keys, but also the default interaction to the cluster - since ceph.conf becomes <cluster_name>.conf Good catch - the fix is likely to touch a number of modules.
Resolved in v1.3 - please retest with this version
Please review the additional variables set in group_vars file that define the cluster name and admin keyring to use.
We are only going to doc this for 2.1. Bug info and workaround added to Doc Text.