Description of problem: I have configured to pull images from Satellite. This is a common customer scenario. It could be any internal registry. Version-Release number of selected component (if applicable): atomic-openshift-utils-3.0.88-1.git.0.31c3daf.el7.noarch How reproducible: Every time. Steps to Reproduce: 1. Install 3.1, make sure you have the following set: #Consume images from Satellite oreg_url=satellite.lab.example.com:5000/lab-ose_docker_images-openshift3_ose-${component}:${version} cli_docker_additional_registries=satellite.lab.example.com:5000 cli_docker_blocked_registries=registry.access.redhat.com,docker.io 2. Before upgrading, the cli_ variables have been renamed Add the following before upgrade: openshift_docker_additional_registries=satellite.lab.example.com:5000 openshift_docker_blocked_registries=registry.access.redhat.com,docker.io 3. Actual results: TASK: [Pull Images] *********************************************************** failed: [master1.lab.example.com] => (item=openshift3/ose) => {"changed": true, "cmd": ["docker", "pull", "openshift3/ose:latest"], "delta": "0:00:00.169635", "end": "2016-05-15 16:57:12.151228", "item": "openshift3/ose", "rc": 1, "start": "2016-05-15 16:57:11.981593", "warnings": []} stderr: Error: image openshift3/ose:latest not found stdout: Trying to pull repository satellite.lab.kupo.se:5000/openshift3/ose ... not found failed: [master2.lab.example.com] => (item=openshift3/ose) => {"changed": true, "cmd": ["docker", "pull", "openshift3/ose:latest"], "delta": "0:00:00.227302", "end": "2016-05-15 16:57:12.235343", "item": "openshift3/ose", "rc": 1, "start": "2016-05-15 16:57:12.008041", "warnings": []} stderr: Error: image openshift3/ose:latest not found stdout: Trying to pull repository satellite.lab.kupo.se:5000/openshift3/ose ... not found failed: [master3.lab.example.com] => (item=openshift3/ose) => {"changed": true, "cmd": ["docker", "pull", "openshift3/ose:latest"], "delta": "0:00:00.311991", "end": "2016-05-15 16:57:12.253718", "item": "openshift3/ose", "rc": 1, "start": "2016-05-15 16:57:11.941727", "warnings": []} stderr: Error: image openshift3/ose:latest not found stdout: Trying to pull repository satellite.lab.kupo.se:5000/openshift3/ose ... not found failed: [node1.lab.example.com] => (item=openshift3/ose) => {"changed": true, "cmd": ["docker", "pull", "openshift3/ose:latest"], "delta": "0:00:00.193200", "end": "2016-05-15 16:57:12.289013", "item": "openshift3/ose", "rc": 1, "start": "2016-05-15 16:57:12.095813", "warnings": []} stderr: Error: image openshift3/ose:latest not found stdout: Trying to pull repository satellite.lab.kupo.se:5000/openshift3/ose ... not found failed: [infra1.lab.example.com] => (item=openshift3/ose) => {"changed": true, "cmd": ["docker", "pull", "openshift3/ose:latest"], "delta": "0:00:00.175980", "end": "2016-05-15 16:57:12.316753", "item": "openshift3/ose", "rc": 1, "start": "2016-05-15 16:57:12.140773", "warnings": []} stderr: Error: image openshift3/ose:latest not found stdout: Trying to pull repository satellite.lab.kupo.se:5000/openshift3/ose ... not found FATAL: all hosts have already failed -- aborting Expected results: Upgrade should succeed. Additional info: Looking in the upgrade playbook this is likely due to a incorrect docker pull command: # The cli image is used by openshift_docker_facts to determine the currently installed # version. We need to explicitly pull the latest image to handle cases where # the locally cached 'latest' tag is older the g_new_version. - name: Download cli image hosts: oo_masters_to_config:oo_nodes_to_config roles: - { role: openshift_docker_facts } tasks: - name: Pull Images command: > docker pull {{ item }}:latest with_items: - "{{ openshift.common.cli_image }}" Somewhere the oreg_url variable should probably be appended here if it was supplied.
We'll have to do some string parsing to make that work for. For now you can set these variables osm_image=satellite.lab.example.com:5000/lab-ose_docker_images-openshift3_ose osn_image=satellite.lab.example.com:5000/lab-ose_docker_images-openshift3_node osn_ovs_image=satellite.lab.example.com:5000/lab-ose_docker_images-openshift3_openvswitch osm_etcd_image=satellite.lab.example.com:5000/lab-ose_docker_images-rhel7_etcd Or whatever the actual image paths are.
Also worth noting, this is a rpm based install. So maybe these images shouldn't be needed to pulled at all?
Oh yeah, that shouldn't be necessary. I have a pending fix for that, let me get that pushed through. https://github.com/openshift/openshift-ansible/pull/1811
Yup, that patch did the trick for me. Thanks!
(Marked a previous comment private as I submitted before completing the comment) Testing of this bug should be limited in scope to RPM installs. If there's significant demand for extrapolating oreg_url in a way that it works for containerized installs we'll open a separate BZ for that. However, I think the workaround in comment #1 is probably sufficient for situations where that's necessary.
Verified, the upgrade don't pull those images any more.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2016:1208