Description of problem: with the current naming convention of downstream packages, ceph ansible is unable to pull docker images. ansible fills in the default values when trying to pull images case 1: when ceph_mon_docker_image_tagis not updated in groups_vars/all file, "latest" tag is used by default ceph_mon_docker_username: rhceph ceph_mon_docker_imagename: ceph-2-rhel-7-docker-candidate-20170206164959 ceph_osd_docker_username: rhceph ceph_osd_docker_imagename: ceph-2-rhel-7-docker-candidate-20170206164959 TASK [ceph-mon : pull ceph daemon image] *************************************** fatal: [ceph-monitor01]: FAILED! => {"changed": false, "cmd": ["docker", "pull", "brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph/ceph-2-rhel-7-docker-candidate-20170206164959:latest"], "delta": "0:00:01.599078", "end": "2017-02-08 12:23:18.673616", "failed": true, "rc": 1, "start": "2017-02-08 12:23:17.074538", "stderr": "unknown: Not Found", "stdout": "Trying to pull repository brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph/ceph-2-rhel-7-docker-candidate-20170206164959 ... ", "stdout_lines": ["Trying to pull repository brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph/ceph-2-rhel-7-docker-candidate-20170206164959 ... "], "warnings": []} to retry, use: --limit @/usr/share/ceph-ansible/site-docker.retry PLAY RECAP ********************************************************************* ceph-monitor01 : ok=17 changed=2 unreachable=0 failed=1 case 2: when ceph_mon_docker_image_tag is set to "", it still fails ceph_mon_docker_username: rhceph ceph_mon_docker_imagename: ceph-2-rhel-7-docker-candidate-20170206164959 ceph_mon_docker_image_tag: "" ceph_osd_docker_username: rhceph ceph_osd_docker_imagename: ceph-2-rhel-7-docker-candidate-20170206164959 ceph_osd_docker_image_tag: "" TASK [ceph-mon : pull ceph daemon image] *************************************** fatal: [ceph-monitor01]: FAILED! => {"changed": false, "cmd": ["docker", "pull", "brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph/ceph-2-rhel-7-docker-candidate-20170206164959:"], "delta": "0:00:00.022068", "end": "2017-02-08 12:26:05.529494", "failed": true, "rc": 1, "start": "2017-02-08 12:26:05.507426", "stderr": "Error parsing reference: \"brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph/ceph-2-rhel-7-docker-candidate-20170206164959:\" is not a valid repository/tag", "stdout": "", "stdout_lines": [], "warnings": []} case 3: when docker_imagename is skipped ceph_mon_docker_username: rhceph #ceph_mon_docker_imagename: ceph-2-rhel-7-docker-candidate-20170206164959 ceph_mon_docker_image_tag: ceph-2-rhel-7-docker-candidate-20170206164959 ceph_osd_docker_username: rhceph #ceph_osd_docker_imagename: ceph-2-rhel-7-docker-candidate-20170206164959 ceph_osd_docker_image_tag: ceph-2-rhel-7-docker-candidate-20170206164959 TASK [ceph-mon : pull ceph daemon image] *************************************** fatal: [ceph-monitor01]: FAILED! => {"changed": false, "cmd": ["docker", "pull", "brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph/daemon:ceph-2-rhel-7-docker-candidate-20170206164959"], "delta": "0:00:01.594566", "end": "2017-02-08 11:59:24.825071", "failed": true, "rc": 1, "start": "2017-02-08 11:59:23.230505", "stderr": "unknown: Not Found", "stdout": "Trying to pull repository brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph/daemon ... ", "stdout_lines": ["Trying to pull repository brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph/daemon ... "], "warnings": []} to retry, use: --limit @/usr/share/ceph-ansible/site-docker.retry PLAY RECAP ********************************************************************* ceph-monitor01 : ok=17 changed=2 unreachable=0 failed=1 case 4: when username is skipped, ceph_mon_docker_imagename: rhceph ceph_mon_docker_image_tag: ceph-2-rhel-7-docker-candidate-20170206164959 ceph_osd_docker_imagename: rhceph ceph_osd_docker_image_tag: ceph-2-rhel-7-docker-candidate-20170206164959 TASK [ceph-mon : pull ceph daemon image] *************************************** fatal: [ceph-monitor01]: FAILED! => {"changed": false, "cmd": ["docker", "pull", "brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/ceph/rhceph:ceph-2-rhel-7-docker-candidate-20170206164959"], "delta": "0:00:01.600035", "end": "2017-02-08 12:31:43.261556", "failed": true, "rc": 1, "start": "2017-02-08 12:31:41.661521", "stderr": "unknown: Not Found", "stdout": "Trying to pull repository brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/ceph/rhceph ... ", "stdout_lines": ["Trying to pull repository brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/ceph/rhceph ... "], "warnings": []} Version-Release number of selected component (if applicable): [root@dhcp46-176 ceph-ansible]# rpm -qa | grep 'ceph-ansible' ceph-ansible-2.1.6-1.el7scon.noarch How reproducible: Always Steps to Reproduce: Provided above Actual results: unable to pull docker images using ceph ansible Expected results: image pull should be made possible when installing ceph docker using ceph ansible. Additional info:
Images should always have a tag, even if you don't specify anything as tag docker will try to fetch the "latest" tag. Make sure your image candidate is tagged and it should work fine.
It looks like "brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/ceph/rhceph" is the image, and "ceph-2-rhel-7-docker-candidate-20170206164959" is the tag. What happens when you try: ceph_mon_docker_username: ceph ceph_mon_docker_imagename: rhceph ceph_mon_docker_image_tag: ceph-2-rhel-7-docker-candidate-20170206164959 ?
If you want to pull from a different docker registry other than docker.io you will also need to set `ceph_docker_registry`. https://github.com/ceph/ceph-ansible/blob/stable-2.1/roles/ceph-docker-common/defaults/main.yml#L3
I'm testing this and I believe there is an hidden bug. Looking into that.
Upstream PR for this: https://github.com/ceph/ceph-ansible/pull/1302
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2017:1496