Created attachment 1652429 [details]
ceph-ansible run logs, inventory and vars

container exec command in crush_rules tasks seems to be always referring to the first member of the mon_group_name

2020-01-15 11:14:29,543 p=523151 u=root |  TASK [ceph-osd : insert new default crush rule into daemon to prevent restart] ***
2020-01-15 11:14:29,543 p=523151 u=root |  task path: /usr/share/ceph-ansible/roles/ceph-osd/tasks/crush_rules.yml:39
2020-01-15 11:14:29,544 p=523151 u=root |  Wednesday 15 January 2020  11:14:29 +0000 (0:00:00.316)       0:08:29.409 ***** 
2020-01-15 11:14:30,451 p=523151 u=root |  ok: [ceph-0 -> 192.168.24.8] => (item=controller-0) => changed=false 
  ansible_loop_var: item
  cmd:
  - podman
  - exec
  - ceph-mon-controller-0
  - ceph
  - --admin-daemon
  - /var/run/ceph/ceph-mon.controller-0.asok
  - config
  - set
  - osd_pool_default_crush_rule
  - '1'
  delta: '0:00:00.466851'
  end: '2020-01-15 11:14:30.414346'
  item: controller-0
  rc: 0
  start: '2020-01-15 11:14:29.947495'
  stderr: ''
  stderr_lines: <omitted>
  stdout: |-
    {
        "success": ""
    }
  stdout_lines: <omitted>
2020-01-15 11:14:30,940 p=523151 u=root |  failed: [ceph-0 -> 192.168.24.10] (item=controller-1) => changed=false 
  ansible_loop_var: item
  cmd:
  - podman
  - exec
  - ceph-mon-controller-0
  - ceph
  - --admin-daemon
  - /var/run/ceph/ceph-mon.controller-1.asok
  - config
  - set
  - osd_pool_default_crush_rule
  - '1'
  delta: '0:00:00.081902'
  end: '2020-01-15 11:14:30.911267'
  item: controller-1
  msg: non-zero return code
  rc: 125
  start: '2020-01-15 11:14:30.829365'
  stderr: 'Error: unable to exec into ceph-mon-controller-0: no container with name or ID ceph-mon-controller-0 found: no such container'
  stderr_lines: <omitted>
  stdout: ''
  stdout_lines: <omitted>
2020-01-15 11:14:31,423 p=523151 u=root |  failed: [ceph-0 -> 192.168.24.30] (item=controller-2) => changed=false 
  ansible_loop_var: item
  cmd:
  - podman
  - exec
  - ceph-mon-controller-0
  - ceph
  - --admin-daemon
  - /var/run/ceph/ceph-mon.controller-2.asok
  - config
  - set
  - osd_pool_default_crush_rule
  - '1'
  delta: '0:00:00.075020'
  end: '2020-01-15 11:14:31.390868'
  item: controller-2
  msg: non-zero return code
  rc: 125
  start: '2020-01-15 11:14:31.315848'
  stderr: 'Error: unable to exec into ceph-mon-controller-0: no container with name or ID ceph-mon-controller-0 found: no such container'
  stderr_lines: <omitted>
  stdout: ''
  stdout_lines: <omitted>

attached are logs, inventory and vars from the failing run