Bug 1626228

Summary: Sometimes builds on api.ci fail with "no such image"
Product: OpenShift Container Platform Reporter: Clayton Coleman <ccoleman>
Component: ContainersAssignee: Tom Sweeney <tsweeney>
Status: CLOSED ERRATA QA Contact: weiwei jiang <wjiang>
Severity: high Docs Contact:
Priority: unspecified    
Version: 3.11.0CC: amurdaca, aos-bugs, bparees, ccoleman, jokerman, mitr, mmccomas, mpatel, pthomas
Target Milestone: ---   
Target Release: 3.11.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-11-20 03:10:43 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
journal from node none

Description Clayton Coleman 2018-09-06 19:01:39 UTC
It looks like this is happening when a new node is autoscaled - every job queues up at the start time, and it *looks* like the registry CA hasn't been propagated.  Not sure why that would be "no such image", but the docker daemon could be doing some sort of error translation in a generic error case.

https://openshift-gce-devel.appspot.com/build/origin-ci-test/pr-logs/pull/20877/pull-ci-origin-verify/2730

2018/09/06 18:31:55 Resolved source https://github.com/openshift/origin to master@c9fe1dac, merging: #20877 a705e2fd @smarterclayton
2018/09/06 18:31:55 Resolving inputs for the test
2018/09/06 18:31:55 Resolved ci/src-cache-origin:master to sha256:ec2aa5820b077776822e93c8bb78dcdeef966f78b8fd0fa09adad0cc6fd4b585
2018/09/06 18:31:55 Resolved openshift/centos:7 to sha256:fc2476ccae2a5186313f2d1dadb4a969d6d2d4c6b23fa98b6c7b0a1faad67685
2018/09/06 18:31:55 Resolved inputs, targetting namespace ci-op-3fks36r4
2018/09/06 18:31:55 Running [input:root], src, bin, verify
2018/09/06 18:31:55 Creating namespace ci-op-3fks36r4
2018/09/06 18:31:56 Setting a soft TTL of 1h0m0s for the namespace
2018/09/06 18:31:56 Setting a hard TTL of 12h0m0s for the namespace
2018/09/06 18:31:56 Setting up pipeline imagestream for the test
2018/09/06 18:31:56 Populating secrets for test
2018/09/06 18:31:56 Tagging ci/src-cache-origin:master into pipeline:root
2018/09/06 18:31:56 Building src
2018/09/06 18:40:03 Build src succeeded after 8m10s
2018/09/06 18:40:03 Building bin
2018/09/06 18:40:47 Build bin failed, printing logs:

Pulling image docker-registry.default.svc:5000/ci-op-3fks36r4/pipeline@sha256:bede18084de0a0f60a1eb688a051ce681a4924c7217df7ce6555f58aacc3e921 ...
error: build error: no such image
2018/09/06 18:40:49 Ran for 8m53s
error: could not run steps: could not wait for build: the build bin failed after 45s with reason DockerBuildFailed: Docker build strategy has failed.

Comment 1 Clayton Coleman 2018-09-06 19:02:06 UTC
docker logs

Sep 06 18:39:29 origin-ci-ig-n-4d9f systemd[1]: Starting Docker Application Container Engine...
Sep 06 18:39:30 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:30.275847091Z" level=warning msg="could not change group /var/run/docker.sock to docker: group docker not found"
Sep 06 18:39:30 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:30.280302217Z" level=info msg="libcontainerd: new containerd process, pid: 1126"
Sep 06 18:39:31 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:31.467129733Z" level=info msg="Graph migration to content-addressability took 0.00 seconds"
Sep 06 18:39:31 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:31.472156131Z" level=info msg="Loading containers: start."
Sep 06 18:39:31 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:31.538569776Z" level=info msg="Firewalld running: false"
Sep 06 18:39:31 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:31.665297626Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Sep 06 18:39:31 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:31.699510768Z" level=info msg="Loading containers: done."
Sep 06 18:39:31 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:31.786879799Z" level=info msg="Daemon has completed initialization"
Sep 06 18:39:31 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:31.786985333Z" level=info msg="Docker daemon" commit="6e3bb8e/1.13.1" graphdriver=overlay2 version=1.13.1
Sep 06 18:39:31 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:31.800525275Z" level=info msg="API listen on /var/run/docker.sock"
Sep 06 18:39:31 origin-ci-ig-n-4d9f systemd[1]: Started Docker Application Container Engine.
Sep 06 18:39:34 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:34.698756514Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-pod:v3.11.0-alpha.0/json returned error: No such image: docker.io/openshift/origin-pod:v3.11.0-alpha.0"
Sep 06 18:39:37 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:37.066290610Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-pod:v3.11.0-alpha.0/json returned error: No such image: docker.io/openshift/origin-pod:v3.11.0-alpha.0"
Sep 06 18:39:37 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:37.066375491Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-pod:v3.11.0-alpha.0/json returned error: No such image: docker.io/openshift/origin-pod:v3.11.0-alpha.0"
Sep 06 18:39:37 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:37.373822469Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-pod:v3.11.0-alpha.0/json returned error: No such image: docker.io/openshift/origin-pod:v3.11.0-alpha.0"
Sep 06 18:39:37 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:37.513861996Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-pod:v3.11.0-alpha.0/json returned error: No such image: docker.io/openshift/origin-pod:v3.11.0-alpha.0"
Sep 06 18:39:43 origin-ci-ig-n-4d9f oci-umount[9301]: umounthook <debug>: prestart container_id:bbe1d4d06ac2 rootfs:/var/lib/docker/overlay2/d03389355ff097be417f03efb466b9e91e3da74a5c5068612bf366040fb842c4/merged
Sep 06 18:39:43 origin-ci-ig-n-4d9f oci-umount[9303]: umounthook <debug>: prestart container_id:7c4f185b3701 rootfs:/var/lib/docker/overlay2/e156e48b9b397d961249c454794079b59e5bc20236de1beb3d40076bb854ce4f/merged
Sep 06 18:39:43 origin-ci-ig-n-4d9f oci-umount[9300]: umounthook <debug>: prestart container_id:0223f8550d18 rootfs:/var/lib/docker/overlay2/de5a15102710b79ef321dfe73a416b48ffe6429f2c6e05fc72a7d705a7045660/merged
Sep 06 18:39:43 origin-ci-ig-n-4d9f oci-umount[9302]: umounthook <debug>: prestart container_id:6bb43069687b rootfs:/var/lib/docker/overlay2/90c31d4d4022747d707c4303b277144d86a34a8dd21d1b3cc04634fd6fb19e86/merged
Sep 06 18:39:43 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:43.777518779Z" level=error msg="Handler for GET /v1.26/images/openshift/prometheus-node-exporter:v0.16.0/json returned error: No such image: openshift/prometheus-node-exporter:v0.16.0"
Sep 06 18:39:43 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:43.777659216Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-node@sha256:227dfbee926d376a210c76dc4638eb68a96203b568f85e07cf321c4e20cf2f12/json returned error: No such image: docker.io/openshift/origin-node@s
Sep 06 18:39:43 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:43.777790107Z" level=error msg="Handler for GET /v1.26/images/openshift/origin-node:v3.10/json returned error: No such image: openshift/origin-node:v3.10"
Sep 06 18:39:43 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:43.778874958Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-node@sha256:227dfbee926d376a210c76dc4638eb68a96203b568f85e07cf321c4e20cf2f12/json returned error: No such image: docker.io/openshift/origin-node@s
Sep 06 18:39:44 origin-ci-ig-n-4d9f oci-umount[9405]: umounthook <debug>: prestart container_id:6d2e6c2f914e rootfs:/var/lib/docker/overlay2/b7f32d22522d19df8c82204b72174721da70c2cecad0a64dda709d05429ead97/merged
Sep 06 18:39:44 origin-ci-ig-n-4d9f oci-umount[9405]: umounthook <info>: 6d2e6c2f914e: mapped host_mnt=/var/lib/docker/overlay2 to cont_mnt=/host/root/var/lib/docker/overlay2
Sep 06 18:39:44 origin-ci-ig-n-4d9f oci-umount[9405]: umounthook <info>: 6d2e6c2f914e: Unmounted: [/var/lib/docker/overlay2/b7f32d22522d19df8c82204b72174721da70c2cecad0a64dda709d05429ead97/merged/host/root/var/lib/docker/overlay2]
Sep 06 18:39:44 origin-ci-ig-n-4d9f oci-umount[9405]: umounthook <info>: 6d2e6c2f914e: mapped host_mnt=/var/lib/docker/containers to cont_mnt=/host/root/var/lib/docker/containers
Sep 06 18:39:44 origin-ci-ig-n-4d9f oci-umount[9405]: umounthook <info>: 6d2e6c2f914e: Unmounted submount: [/var/lib/docker/overlay2/b7f32d22522d19df8c82204b72174721da70c2cecad0a64dda709d05429ead97/merged/host/root/var/lib/docker/containers/7c4f185b370197524f53aa6899caea4c128eb079a92c582437f782d7a86ad739/shm]
Sep 06 18:39:44 origin-ci-ig-n-4d9f oci-umount[9405]: umounthook <info>: 6d2e6c2f914e: Unmounted submount: [/var/lib/docker/overlay2/b7f32d22522d19df8c82204b72174721da70c2cecad0a64dda709d05429ead97/merged/host/root/var/lib/docker/containers/0223f8550d18ee32537c51c2c269053cfad2f8229d3f913dd0e9158e3b95c11c/shm]
Sep 06 18:39:44 origin-ci-ig-n-4d9f oci-umount[9405]: umounthook <info>: 6d2e6c2f914e: Unmounted submount: [/var/lib/docker/overlay2/b7f32d22522d19df8c82204b72174721da70c2cecad0a64dda709d05429ead97/merged/host/root/var/lib/docker/containers/bbe1d4d06ac21e1c2177dd4f25f0be1dc6109466b40c6d4ef553fa155a31516f/shm]
Sep 06 18:39:44 origin-ci-ig-n-4d9f oci-umount[9405]: umounthook <info>: 6d2e6c2f914e: Unmounted submount: [/var/lib/docker/overlay2/b7f32d22522d19df8c82204b72174721da70c2cecad0a64dda709d05429ead97/merged/host/root/var/lib/docker/containers/6bb43069687bd061f88ca754e8a9e84ea94f2022dd38742f70aef86aec10b412/shm]
Sep 06 18:39:44 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:39:44.839086754Z" level=error msg="Handler for GET /v1.26/images/quay.io/coreos/kube-rbac-proxy:v0.3.1/json returned error: No such image: quay.io/coreos/kube-rbac-proxy:v0.3.1"
Sep 06 18:40:03 origin-ci-ig-n-4d9f oci-umount[10635]: umounthook <debug>: prestart container_id:4d25c1109a13 rootfs:/var/lib/docker/overlay2/0d6566e0eb603023edc440b5985c41fe9e2e1cdbd70f57830ad32c989b369194/merged
Sep 06 18:40:04 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:04.430559399Z" level=error msg="Error trying v2 registry: context canceled"
Sep 06 18:40:04 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:04.430609249Z" level=error msg="Not continuing with pull after error: context canceled"
Sep 06 18:40:10 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:10.357658503Z" level=error msg="Handler for GET /v1.26/images/openshift/origin-pod:v3.10.0/json returned error: No such image: openshift/origin-pod:v3.10.0"
Sep 06 18:40:12 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:12.707662963Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-node@sha256:227dfbee926d376a210c76dc4638eb68a96203b568f85e07cf321c4e20cf2f12/json returned error: No such image: docker.io/openshift/origin-node@s
Sep 06 18:40:12 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:12.707724010Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-node@sha256:227dfbee926d376a210c76dc4638eb68a96203b568f85e07cf321c4e20cf2f12/json returned error: No such image: docker.io/openshift/origin-node@s
Sep 06 18:40:12 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:12.907278769Z" level=error msg="Handler for GET /v1.26/images/quay.io/coreos/kube-rbac-proxy:v0.3.1/json returned error: No such image: quay.io/coreos/kube-rbac-proxy:v0.3.1"
Sep 06 18:40:29 origin-ci-ig-n-4d9f oci-systemd-hook[10940]: systemdhook <debug>: 405ca117a697: Skipping as container command is /bin/bash, not init or systemd
Sep 06 18:40:29 origin-ci-ig-n-4d9f oci-umount[10941]: umounthook <debug>: prestart container_id:405ca117a697 rootfs:/var/lib/docker/overlay2/632187bdea0b1ce6c033b6ac34f942666f29fb616e576df201f0c390e6d5fe06/merged
Sep 06 18:40:30 origin-ci-ig-n-4d9f oci-systemd-hook[11009]: systemdhook <debug>: 2750d38d31b6: Skipping as container command is /bin/bash, not init or systemd
Sep 06 18:40:30 origin-ci-ig-n-4d9f oci-umount[11011]: umounthook <debug>: prestart container_id:2750d38d31b6 rootfs:/var/lib/docker/overlay2/360607c3ce2555774a072eac804e9ca2bd70982fca2836e60276089167d28d29/merged
Sep 06 18:40:33 origin-ci-ig-n-4d9f oci-umount[11361]: umounthook <debug>: prestart container_id:4bcf4678203e rootfs:/var/lib/docker/overlay2/ce27bb342533a818a009fde4b2c36e701f5a1a1c1c31bcd203aa1eb15aa9b2d9/merged
Sep 06 18:40:40 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:40.938249754Z" level=error msg="Handler for GET /v1.26/images/openshift/origin-pod:v3.10.0/json returned error: No such image: openshift/origin-pod:v3.10.0"
Sep 06 18:40:40 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:40.944345156Z" level=error msg="Handler for GET /v1.26/images/openshift/origin-pod:v3.10.0/json returned error: No such image: openshift/origin-pod:v3.10.0"
Sep 06 18:40:42 origin-ci-ig-n-4d9f oci-umount[11508]: umounthook <debug>: prestart container_id:d8a095a64fff rootfs:/var/lib/docker/overlay2/bf8276ca5bfaaa389bd44ce6958bb7b8ab767ad3c56e09d4f4ded23674e55191/merged
Sep 06 18:40:42 origin-ci-ig-n-4d9f oci-umount[11517]: umounthook <debug>: prestart container_id:9fbe9ded56e0 rootfs:/var/lib/docker/overlay2/b1b2b59000bff93f8b1a60234f21f65a0697cdcea0ece37c035b3ddd40ec2dde/merged
Sep 06 18:40:43 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:43.851676621Z" level=error msg="Handler for GET /v1.26/images/docker.io/openshift/origin-docker-builder:v3.10.0/json returned error: No such image: docker.io/openshift/origin-docker-builder:v3.10.0"
Sep 06 18:40:43 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:43.852497778Z" level=error msg="Handler for GET /v1.26/images/docker-registry.default.svc:5000/ci-op-3fks36r4/pipeline@sha256:bede18084de0a0f60a1eb688a051ce681a4924c7217df7ce6555f58aacc3e921/json returned error: No such image: docker-r
Sep 06 18:40:45 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:45.537880054Z" level=warning msg="Error getting v2 registry: Get https://docker-registry.default.svc:5000/v2/: x509: certificate signed by unknown authority"
Sep 06 18:40:45 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:45.537937904Z" level=error msg="Attempting next endpoint for pull after error: Get https://docker-registry.default.svc:5000/v2/: x509: certificate signed by unknown authority"
Sep 06 18:40:45 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:45.537962275Z" level=error msg="Attempting next endpoint for pull after error: Cannot pull by digest with v1 registry"
Sep 06 18:40:45 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:45.539528204Z" level=error msg="Handler for GET /v1.26/images/busybox:latest/json returned error: No such image: busybox:latest"
Sep 06 18:40:45 origin-ci-ig-n-4d9f oci-umount[11676]: umounthook <debug>: prestart container_id:5d48d323eb7a rootfs:/var/lib/docker/overlay2/839decab840d8ebca1056c8d0df3f0d6efafa3fd5b93a9012efd6393c6b262ee/merged
Sep 06 18:40:45 origin-ci-ig-n-4d9f oci-umount[11756]: umounthook <debug>: prestart container_id:b2216fd1aa09 rootfs:/var/lib/docker/overlay2/afc8329a1d55f868e202d870d72f5b19ee0695a57a62fb46362ecfbe30239188/merged
Sep 06 18:40:45 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:45.864250443Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 5d48d323eb7a180640b0cf457411fc2e5736433d517f5b2832f1dba755c6bb7c does not exist\\none or more of the container deletions failed\\n\""
Sep 06 18:40:45 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:45.872538210Z" level=warning msg="5d48d323eb7a180640b0cf457411fc2e5736433d517f5b2832f1dba755c6bb7c cleanup: failed to unmount secrets: invalid argument"
Sep 06 18:40:46 origin-ci-ig-n-4d9f oci-umount[11864]: umounthook <debug>: prestart container_id:b0738857827b rootfs:/var/lib/docker/overlay2/6d63f574f7cc4f9f92a57b1de5185b01b1fe17681bff0d357fb9a3f89b472ccf/merged
Sep 06 18:40:46 origin-ci-ig-n-4d9f oci-umount[11907]: umounthook <debug>: prestart container_id:7e030466f87f rootfs:/var/lib/docker/overlay2/eebfbbf10fea632cd11adc9aff7d907b37f25c3ed7a6c0e7a146ad492c5ff846/merged
Sep 06 18:40:46 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:46.939147613Z" level=error msg="Handler for GET /images/docker-registry.default.svc:5000/ci-op-3fks36r4/pipeline@sha256:bede18084de0a0f60a1eb688a051ce681a4924c7217df7ce6555f58aacc3e921/json returned error: No such image: docker-registr
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.003258470Z" level=warning msg="Error getting v2 registry: Get https://docker-registry.default.svc:5000/v2/: x509: certificate signed by unknown authority"
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.003312442Z" level=error msg="Attempting next endpoint for pull after error: Get https://docker-registry.default.svc:5000/v2/: x509: certificate signed by unknown authority"
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.003327750Z" level=error msg="Attempting next endpoint for pull after error: Cannot pull by digest with v1 registry"
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.005948263Z" level=error msg="Handler for GET /images/docker-registry.default.svc:5000/ci-op-3fks36r4/pipeline@sha256:bede18084de0a0f60a1eb688a051ce681a4924c7217df7ce6555f58aacc3e921/json returned error: No such image: docker-registr
Sep 06 18:40:47 origin-ci-ig-n-4d9f oci-systemd-hook[11951]: systemdhook <debug>: 7e030466f87f: Skipping as container command is openshift-docker-build, not init or systemd
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.108819881Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 7e030466f87fca342ee9a1472baed33bcfde20a023aba14fda49858ac369c446 does not exist\\none or more of the container deletions failed\\n\""
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.114680887Z" level=warning msg="7e030466f87fca342ee9a1472baed33bcfde20a023aba14fda49858ac369c446 cleanup: failed to unmount secrets: invalid argument"
Sep 06 18:40:47 origin-ci-ig-n-4d9f oci-umount[11995]: umounthook <debug>: prestart container_id:7ae5e77ebe11 rootfs:/var/lib/docker/overlay2/a0a7f447fafbd60d4fc9042c1be3828c546bb43235fcc47b5cb168cc42ea42b3/merged
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.491815197Z" level=error msg="containerd: deleting container" error="exit status 1: \"container d8a095a64fff8d20eaec9beb1949cf54fa8edd0c4c71f11c8c8d7ae6b726e360 does not exist\\none or more of the container deletions failed\\n\""
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.523427762Z" level=warning msg="d8a095a64fff8d20eaec9beb1949cf54fa8edd0c4c71f11c8c8d7ae6b726e360 cleanup: failed to unmount secrets: invalid argument"
Sep 06 18:40:47 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:47.744856909Z" level=error msg="Handler for GET /v1.26/images/docker-registry.default.svc:5000/ci-op-3fks36r4/pipeline@sha256:bede18084de0a0f60a1eb688a051ce681a4924c7217df7ce6555f58aacc3e921/json returned error: No such image: docker-r
Sep 06 18:40:49 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:48.745515732Z" level=error msg="Handler for GET /v1.26/images/docker-registry.default.svc:5000/ci-op-3fks36r4/pipeline@sha256:bede18084de0a0f60a1eb688a051ce681a4924c7217df7ce6555f58aacc3e921/json returned error: No such image: docker-r
Sep 06 18:40:49 origin-ci-ig-n-4d9f oci-umount[12115]: umounthook <debug>: prestart container_id:b226581e4dbf rootfs:/var/lib/docker/overlay2/08d46a34135820a1b1e0394c6b7f3f45f75f186599c4e2264dfdaaec81939fa9/merged
Sep 06 18:40:51 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:51.270065801Z" level=error msg="Handler for GET /v1.26/images/docker-registry.default.svc:5000/ci-op-6hxv5pc0/pipeline@sha256:4071b804e9017e8b14c72c645a0359925d704617d29c3ba0497aedb929e143ff/json returned error: No such image: docker-r
Sep 06 18:40:59 origin-ci-ig-n-4d9f dockerd-current[984]: time="2018-09-06T18:40:59.657170475Z" level=error msg="Handler for GET /v1.26/images/docker-registry.default.svc:5000/ci-op-3fks36r4/pipeline@sha256:bede18084de0a0f60a1eb688a051ce681a4924c7217df7ce6555f58aacc3e921/json returned error: No such image: docker-r
Sep 06 18:41:11 origin-ci-ig-n-4d9f oci-umount[12355]: umounthook <debug>: prestart container_id:0ce0d8ab0e56 rootfs:/var/lib/docker/overlay2/94fed963eea948981e2e89dcc5845fe57ea4ebd6a3b0143d2ff7f964a3202ff5/merged

Comment 2 Clayton Coleman 2018-09-06 19:03:14 UTC
Created attachment 1481401 [details]
journal from node

Comment 3 Ben Parees 2018-09-06 19:25:41 UTC
have you established whether or not the registry received a request for this image?

also please start running your builds with loglevel 4.

Comment 4 Ben Parees 2018-09-06 20:28:14 UTC
The code we run to pull the image is here:
https://github.com/openshift/origin/blob/master/pkg/build/builder/docker.go#L114-L126

https://github.com/openshift/origin/blob/master/pkg/build/builder/dockerutil.go#L112-L145

https://github.com/openshift/origin/blob/master/pkg/build/builder/dockerutil.go#L71-L110


based on that, we did not get an error while pulling the image, yet imagebuilder could not find the image locally when it ran (resulting in the "no such image" error), so this seems like a docker daemon problem (something lied to us about having successfully pulled the image).

The actual reason the pull did *not* succeed is here:
time="2018-09-06T18:40:45.537880054Z" level=warning msg="Error getting v2 registry: Get https://docker-registry.default.svc:5000/v2/: x509: certificate signed by unknown authority"

but that should have resulted in us getting an error.

Comment 5 Antonio Murdaca 2018-09-07 07:03:03 UTC
That certificate error isn't an error from Docker itself, it's rather a misconfigured certificate for the internal registry.
Do you have the certificate on the node? I recall one similar bug to this and the certificate wasn't there.

Comment 6 Miloslav Trmač 2018-09-08 01:29:57 UTC
(In reply to Antonio Murdaca from comment #5)
> Do you have the certificate on the node? I recall one similar bug to this
> and the certificate wasn't there.

Note that the pull fails on 18:40:45.538575, but at 18:41:21.224624 pulling the same image starts, and ultimately succeeds.  The service-cert-sync-ffrsr_openshift-node pod name seems related at a first glance, and does start between the failed and successful attempt, and has even more related volumes mounted (docker-cert-sync-token-bswz5 , dockercert); but GitHub can’t find any mentions of these strings anywhere in the OpenShift organization.

Anyway, why the root of trust was temporarily not present, and why the build did not notice that the pull failed, seem to be unrelated questions so far.

Comment 7 Miloslav Trmač 2018-09-08 02:32:30 UTC
(In reply to Ben Parees from comment #4)
> based on that, we did not get an error while pulling the image, yet
> imagebuilder could not find the image locally when it ran (resulting in the
> "no such image" error), so this seems like a docker daemon problem
> (something lied to us about having successfully pulled the image).

That actually looks (untested) like a bug in the build code.  The pull engine API returns a HTTP error code only on immediate failures; otherwise, it returns 200, and the body is a stream of progress messages, which needs to be decoded to detect a failure:

(shortened)
> # curl -v --unix-socket /var/run/docker.sock -X POST "http:/v1.24/images/create?fromImage=ABCD"
> > POST /images/create?fromImage=ABCD HTTP/1.1
> > 
> < HTTP/1.1 500 Internal Server Error
> < Api-Version: 1.26
> < Content-Type: application/json
> < 
> {"message":"Error parsing reference: \"ABCD\" is not a valid repository/tag: repository name must be lowercase"}

> # curl -v --unix-socket /var/run/docker.sock -X POST "http:/v1.24/images/create?fromImage=thisdoesnotexist/anywhere"
> > POST /images/create?fromImage=thisdoesnotexist/anywhere HTTP/1.1
> > 
> < HTTP/1.1 200 OK
> < Api-Version: 1.26
> < Content-Type: application/json
> < Transfer-Encoding: chunked
> < 
> {"status":"Trying to pull repository docker.io/thisdoesnotexist/anywhere ... "}> {"errorDetail":{"message":"repository docker.io/thisdoesnotexist/anywhere not found: does not exist or no pull access"},"error":"repository docker.io/thisdoesnotexist/anywhere not found: does not exist or no pull access"}

fsouza/go-dockerclient.Client.PullImage does, by default, handle this transparently for callers in https://github.com/openshift/origin/blob/bcb14cc64f420c694617b1ca3f4f7d429610cf57/vendor/github.com/fsouza/go-dockerclient/client.go#L634-L643 (ultimately https://github.com/openshift/origin/blob/bcb14cc64f420c694617b1ca3f4f7d429610cf57/vendor/github.com/docker/docker/pkg/jsonmessage/jsonmessage.go#L187-L192 ).

origin/pkg/build/builder , though, opts out of that implementation by setting RawJSONStream to true at https://github.com/openshift/origin/blob/632da5994c2e02430ece70db2e42c16ed3613d60/pkg/build/builder/dockerutil.go#L138 , and the imageprogress subpackage does not implement the error detection AFAICS: https://github.com/openshift/origin/blob/bcb14cc64f420c694617b1ca3f4f7d429610cf57/vendor/github.com/openshift/imagebuilder/imageprogress/progress.go#L200-L205 explicitly ignores any line that does not contain a layer ID, and that function can not return an error to the caller anyway; in fact https://github.com/openshift/origin/blob/bcb14cc64f420c694617b1ca3f4f7d429610cf57/vendor/github.com/openshift/imagebuilder/imageprogress/progress_test.go#L56-L68 explicitly tests that errors are ignored.


[This could explain why the builder did not notice the error; I don’t currently understand the context of the deployment enough to investigate why the certificate is not trusted.]

Comment 8 Miloslav Trmač 2018-09-08 06:10:13 UTC
> That actually looks (untested) like a bug in the build code.

Confirmed: with (truncated to essential fields)
> apiVersion: build.openshift.io/v1
> kind: BuildConfig
> spec:
>   source:
>     dockerfile: |-
>       FROM busybox:thisdoesnotexist
>       ENV a=a
>     type: Dockerfile
>   strategy:
>     dockerStrategy:
>       env:
>       - name: BUILD_LOGLEVEL
>         value: "4"
>       forcePull: true
>       imageOptimizationPolicy: SkipLayers
>     type: Docker

> # oc start-build --follow bc/test1> Pulling image busybox:thisdoesnotexist ...
> I0908 06:01:20.922053       1 docker.go:116] pulling image "busybox:thisdoesnotexist" with ref reference.DockerImageReference{Registry:"", Namespace:"", Name:"busybox", Tag:"", ID:""} as repository: busybox and tag: thisdoesnotexist
(at this point pullImage() has finished and not reported any error, ClientExecutor.Prepare tries to pull it again)
> I0908 06:01:23.835326       1 client.go:248] Retrieving image "busybox:thisdoesnotexist"
> I0908 06:01:23.841008       1 client.go:554] image busybox:thisdoesnotexist did not exist
> I0908 06:01:23.907509       1 wait.go:203] Retryable error occurred, retrying.  error: Operation cannot be fulfilled on builds.build.openshift.io "test1-8": the object has been modified; please apply your changes to the latest version and try again
> F0908 06:01:23.949418       1 helpers.go:119] error: build error: no such image
(AFAICS ClientExecutor.Prepare likewise ignores the pull error, but e.Client.InspectImage then fails with "no such image".)

This reproduces the same error message; without imageOptimizationPolicy the error path is different but of course the build ultimately fails as well.

---

Based on
> every job queues up at the start time, and it *looks* like the registry CA hasn't been propagated.

in the original description I assume that “why was the error ignored” is a more interesting question in this bug than ”why is the registry server not trusted for TLS”, so reassigning to the build component.

Comment 9 Miloslav Trmač 2018-09-08 06:13:49 UTC
BTW github.com/openshift/imagebuilder/imageprogress did at one point contain the code two detect and report errors, but it was removed in https://github.com/openshift/imagebuilder/pull/45 .  It does look like the version before that PR was not quite reliable enough (the PipeReader.CloseWithError was not guaranteed to be noticed by the writer AFAICT).

Comment 10 Ben Parees 2018-09-08 13:51:24 UTC
Thanks Miloslav, that all makes sense, however imagebuilder is now owned by the runtimes team as part of the ownership of buildah, so i'm still moving this back to that team to fix the progress writer to detect errors properly.

Comment 12 Ben Parees 2018-09-11 13:21:30 UTC
It's entirely possible this is broken in 3.10 also... due to the nature of the bug, it wouldn't surprise me if no one noticed the behavior.

For a "normal" docker strategy build, even if our pull attempt silently failed, the "docker build" invocation would still attempt to pull the image and possibly succeed if conditions had changed.  And if docker's attempt to pull still failed, the build would fail and normally that would also be expected since it's quite rare that a retry of a pull would help things.  It would just look like a "failed to pull" build failure, at least based on the logs (the build failure reason would be "docker build failed" instead of "image pull failed" but that's not something most people are going to notice).


It's only when using the "imagebuilder" optimization strategy that things look "weird" because the logs show us successfully pulling the image and then imagebuilder says it can't find it (because unlike docker, imagebuilder doesn't attempt to pull the image itself).  Even in this case, for most people the failure is probably "acceptable/unsurprising".

The two main issues w/ this bug are:

1) until it's fixed our "retry the pull in some conditions" logic won't get run (which, if it applied to this particular error/condition, would have probably allowed the build to succeed by retrying long enough for the CA to show up)

2) the logs are very confusing since it looks like we successfully pulled the image(even though we didn't), but imagebuilder says it can't find it.

Comment 13 Antonio Murdaca 2018-09-11 13:25:20 UTC
Miloslav, you pointed out https://github.com/openshift/imagebuilder/pull/45 as being the root cause of this issue, should we revert that? Or that piece of code must be reworked altogether?

Comment 14 Ben Parees 2018-09-11 13:31:27 UTC
I don't think you want to straight up revert that, I think the fundamental thing it fixed was legitimate (go routine management).

the fact that it removed the error checking/handling was, I assume, inadvertent and can be added back in w/o reverting the rest of the PR.

Comment 15 Antonio Murdaca 2018-09-11 13:36:06 UTC
(In reply to Ben Parees from comment #14)
> I don't think you want to straight up revert that, I think the fundamental
> thing it fixed was legitimate (go routine management).
> 
> the fact that it removed the error checking/handling was, I assume,
> inadvertent and can be added back in w/o reverting the rest of the PR.

makes sense yeah

Comment 16 Tom Sweeney 2018-09-11 18:36:40 UTC
I've posted a PR at:  https://github.com/openshift/imagebuilder/pull/96 which added the previous error checking back into the code.  However I've not gotten the error to trigger in the gotest as I thought they should/would.  I'm not terribly familiar with this chunk of code, so if there are suggestions, I'm happy to field them in the PR.

Comment 18 Tom Sweeney 2018-09-12 17:28:56 UTC
I'm going to close my PR #96 as Miloslav's PR https://github.com/openshift/imagebuilder/pull/97 fills the bill.

Comment 19 Ben Parees 2018-09-24 15:12:34 UTC
This has been vendored into origin/master(4.0).

It will still need to be backported into 3.10+3.11 in ose, probably after the 3.11 GA dust settles.

Comment 20 Miloslav Trmač 2018-09-27 19:17:08 UTC
(In reply to Ben Parees from comment #19)
> This has been vendored into origin/master(4.0).
> 
> It will still need to be backported into 3.10+3.11 in ose, probably after
> the 3.11 GA dust settles.

https://github.com/openshift/imagebuilder/pull/97 has indeed been vendored;

Note that https://github.com/openshift/origin/pull/20941 still hasn’t been merged, though.

Comment 21 Ben Parees 2018-09-27 19:23:56 UTC
That PR will never merge into master at this point as pkg/build/builder is moving out of origin.

We will have to look at adapting it to the new openshift/builder repository after the dust settles on switching to dockerless builds.

Comment 23 Ben Parees 2018-10-14 03:01:21 UTC
Incidentally, this behavior appears to have been changed at some point because in docker v18.06.1-ce


$ curl -v --unix-socket /var/run/docker.sock -X POST "http:/v1.24/images/create?fromImage=thisdoesnotexist/anywhere"
* Unwillingly accepted illegal URL using 1 slash!
*   Trying /var/run/docker.sock...
* Connected to v1.24 (/var/run/docker.sock) port 80 (#0)
> POST /images/create?fromImage=thisdoesnotexist/anywhere HTTP/1.1
> Host: v1.24
> User-Agent: curl/7.59.0
> Accept: */*
> 
< HTTP/1.1 404 Not Found

Comment 24 Miloslav Trmač 2018-10-15 15:54:48 UTC
(In reply to Ben Parees from comment #23)
> Incidentally, this behavior appears to have been changed at some point
> because in docker v18.06.1-ce
> 
> $ curl -v --unix-socket /var/run/docker.sock -X POST
> "http:/v1.24/images/create?fromImage=thisdoesnotexist/anywhere"> < HTTP/1.1 404 Not Found

I expect you’d see the same behavior in upstream 1.13.

The HTTP server does not have separate categories of errors reported immediately / in the progress output:

It initially does not send return any output and invokes the underlying operation
- if that operation fails without any preceding progress output, it reports the failure as a HTTP protocol failure
- if that operation starts producing progress output, it sends a 200 OK header and streams the progress output; if the operation eventually fails, it is formatted as a component of the stream output (the handler can’t go back in time and change the 200 OK into a failure).

In this example, the full progress output is
> {"status":"Trying to pull repository docker.io/thisdoesnotexist/anywhere ... "}> {"status":"Trying to pull repository docker.io/thisdoesnotexist/anywhere ... "}
> {"errorDetail":{"message":"repository docker.io/thisdoesnotexist/anywhere not found: does not exist or no pull access"},"error":"repository docker.io/thisdoesnotexist/anywhere not found: does not exist or no pull access"}

and the "Trying to pull repository …" messages have been added by the “Add --add-registry and --block-registry options to docker daemon” projectatomic/docker patch.  Those progress messages cause the error reporting to use the progress channel; if they are absent (as they are upstream), error reporting uses the HTTP status.

Comment 27 weiwei jiang 2018-11-02 11:09:52 UTC
Checked with 
# oc version 
oc v3.11.36
kubernetes v1.11.0+d4cacc0
features: Basic-Auth GSSAPI Kerberos SPNEGO

Server https://qe-wjiang-master-etcd-1:8443
openshift v3.11.36
kubernetes v1.11.0+d4cacc0
# openshift-docker-build version
openshift-docker-build v3.11.36

And can not reproduce this issue.

Comment 28 weiwei jiang 2018-11-02 11:25:22 UTC
verified logs:

# oc logs -f ruby22-sample-build-1-build
I1102 11:23:29.894856       1 builder.go:82] redacted build: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36212","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a=a"},"strategy":{"type":"Docker","dockerStrategy":{"env":[{"name":"EXAMPLE","value":"sample-app"},{"name":"RACK_ENV","value":"devexp"},{"name":"BUILD_LOGLEVEL","value":"8"}]}},"output":{"to":{"kind":"DockerImage","name":"docker-registry.default.svc:5000/default/origin-ruby22-sample:latest"},"pushSecret":{"name":"builder-dockercfg-ktrcp"}},"resources":{},"postCommit":{},"nodeSelector":null,"triggeredBy":[{"message":"Build configuration change"}]},"status":{"phase":"New","outputDockerImageReference":"docker-registry.default.svc:5000/default/origin-ruby22-sample:latest","config":{"kind":"BuildConfig","namespace":"default","name":"ruby22-sample-build"},"output":{}}}                                                                                                                                                                                                                          
I1102 11:23:29.897269       1 util_linux.go:70] found cgroup values map: map[devices:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope cpuset:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope cpu:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope hugetlb:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope perf_event:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope memory:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope pids:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope net_prio:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope net_cls:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope name=systemd:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope blkio:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope freezer:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope cpuacct:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope]
I1102 11:23:29.897292       1 util_linux.go:96] cgroup memory subsystem value: /kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice/docker-db74312154d1e21a4f675375754eee2be4958408c18f6774f97ff7d74e4dd837.scope
I1102 11:23:29.897304       1 util_linux.go:96] found cgroup parent kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice
I1102 11:23:29.897314       1 builder.go:223] Running build with cgroup limits: api.CGroupLimits{MemoryLimitBytes:92233720368547, CPUShares:0, CPUPeriod:0, CPUQuota:0, MemorySwap:92233720368547, Parent:"kubepods-besteffort-podb665bfe1_de91_11e8_9cb2_42010af00028.slice"}
I1102 11:23:29.897355       1 builder.go:240] Starting Docker build from build config ruby22-sample-build-1 ...
I1102 11:23:29.918278       1 cfg.go:39] Locating docker auth for image busybox:notexist and type PULL_DOCKERCFG_PATH
I1102 11:23:29.918306       1 cfg.go:49] Getting docker auth in paths : []
I1102 11:23:29.918366       1 config.go:131] looking for config.json at /config.json
I1102 11:23:29.918402       1 config.go:131] looking for config.json at /config.json
I1102 11:23:29.918415       1 config.go:131] looking for config.json at /root/.docker/config.json
I1102 11:23:29.918435       1 config.go:131] looking for config.json at /.docker/config.json

Pulling image busybox:notexist ...
I1102 11:23:29.918620       1 docker.go:116] pulling image "busybox:notexist" with ref reference.DockerImageReference{Registry:"", Namespace:"", Name:"busybox", Tag:"", ID:""} as repository: busybox and tag: notexist
Trying to pull repository registry.redhat.io/busybox ...
Trying to pull repository registry.access.redhat.com/busybox ...
Trying to pull repository docker.io/library/busybox ...
I1102 11:23:31.432947       1 round_trippers.go:383] GET https://172.30.0.1:443/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1
I1102 11:23:31.432969       1 round_trippers.go:390] Request Headers:
I1102 11:23:31.432979       1 round_trippers.go:393]     Accept: application/json, */*
I1102 11:23:31.432988       1 round_trippers.go:393]     User-Agent: openshift-docker-build/v1.11.0+d4cacc0 (linux/amd64) kubernetes/d4cacc0
I1102 11:23:31.432996       1 round_trippers.go:393]     Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJkZWZhdWx0Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6ImJ1aWxkZXItdG9rZW4tdmd6bngiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoiYnVpbGRlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImEyZWVlNDg3LWRlNmUtMTFlOC05Y2IyLTQyMDEwYWYwMDAyOCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpkZWZhdWx0OmJ1aWxkZXIifQ.aj1zCuMS3t7K4V1ZBDuGsyH_v909x1fw_R0fkavmNV1CRz0AFKL-e7Z6HjepTdghV9GbYks0ezSNmH_r0u6-pCDBqsQnLJpTSJlRZUwEYsFnqPi7S5k6lNhloO2MMJzMqcQqOkLCYfElzECvJkn_eRvxOTB6CJB1CSgXIUFPK10R9otWdBe34V5f7-1i5oP7UP5sLT3RWvSw45rkUoi44e_7A93YR3EJBBaZi3KKWXH_58xQCZM9W_U9sKefgxAtbfAnSqOqBHvWsOxz0tGou6sOcSKiyf7IFdRjVaTANZ_hhrmB2rRWJoHdV39WYlu0DnB_kxPbBweR8dM6L0aFuA
I1102 11:23:31.450825       1 round_trippers.go:408] Response Status: 200 OK in 17 milliseconds
I1102 11:23:31.450860       1 round_trippers.go:411] Response Headers:
I1102 11:23:31.450871       1 round_trippers.go:414]     Cache-Control: no-store
I1102 11:23:31.450880       1 round_trippers.go:414]     Content-Type: application/json
I1102 11:23:31.450888       1 round_trippers.go:414]     Content-Length: 1692
I1102 11:23:31.450894       1 round_trippers.go:414]     Date: Fri, 02 Nov 2018 11:23:31 GMT
I1102 11:23:31.450952       1 request.go:897] Response Body: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36250","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1","openshift.io/build.pod-name":"ruby22-sample-build-1-build"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a=a"},"str [truncated 668 chars]                                                                                                                                                                  
I1102 11:23:31.451458       1 request.go:897] Request Body: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36250","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1","openshift.io/build.pod-name":"ruby22-sample-build-1-build"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a=a"},"str [truncated 743 chars]                                                                                                                                                                   
I1102 11:23:31.451550       1 round_trippers.go:383] PUT https://172.30.0.1:443/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1/details
I1102 11:23:31.451563       1 round_trippers.go:390] Request Headers:
I1102 11:23:31.451571       1 round_trippers.go:393]     Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJkZWZhdWx0Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6ImJ1aWxkZXItdG9rZW4tdmd6bngiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoiYnVpbGRlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImEyZWVlNDg3LWRlNmUtMTFlOC05Y2IyLTQyMDEwYWYwMDAyOCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpkZWZhdWx0OmJ1aWxkZXIifQ.aj1zCuMS3t7K4V1ZBDuGsyH_v909x1fw_R0fkavmNV1CRz0AFKL-e7Z6HjepTdghV9GbYks0ezSNmH_r0u6-pCDBqsQnLJpTSJlRZUwEYsFnqPi7S5k6lNhloO2MMJzMqcQqOkLCYfElzECvJkn_eRvxOTB6CJB1CSgXIUFPK10R9otWdBe34V5f7-1i5oP7UP5sLT3RWvSw45rkUoi44e_7A93YR3EJBBaZi3KKWXH_58xQCZM9W_U9sKefgxAtbfAnSqOqBHvWsOxz0tGou6sOcSKiyf7IFdRjVaTANZ_hhrmB2rRWJoHdV39WYlu0DnB_kxPbBweR8dM6L0aFuA
I1102 11:23:31.451580       1 round_trippers.go:393]     Content-Type: application/json
I1102 11:23:31.451589       1 round_trippers.go:393]     User-Agent: openshift-docker-build/v1.11.0+d4cacc0 (linux/amd64) kubernetes/d4cacc0
I1102 11:23:31.451598       1 round_trippers.go:393]     Accept: application/json, */*
I1102 11:23:31.456986       1 round_trippers.go:408] Response Status: 200 OK in 5 milliseconds
I1102 11:23:31.457010       1 round_trippers.go:411] Response Headers:
I1102 11:23:31.457019       1 round_trippers.go:414]     Content-Length: 1775
I1102 11:23:31.457027       1 round_trippers.go:414]     Date: Fri, 02 Nov 2018 11:23:31 GMT
I1102 11:23:31.457034       1 round_trippers.go:414]     Cache-Control: no-store
I1102 11:23:31.457042       1 round_trippers.go:414]     Content-Type: application/json
I1102 11:23:31.457189       1 request.go:897] Response Body: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1/details","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36258","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1","openshift.io/build.pod-name":"ruby22-sample-build-1-build"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a= [truncated 751 chars]                                                                                                                                                                  
I1102 11:23:31.457414       1 round_trippers.go:383] GET https://172.30.0.1:443/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1
I1102 11:23:31.457431       1 round_trippers.go:390] Request Headers:
I1102 11:23:31.457439       1 round_trippers.go:393]     Accept: application/json, */*
I1102 11:23:31.457452       1 round_trippers.go:393]     User-Agent: openshift-docker-build/v1.11.0+d4cacc0 (linux/amd64) kubernetes/d4cacc0
I1102 11:23:31.457464       1 round_trippers.go:393]     Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJkZWZhdWx0Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6ImJ1aWxkZXItdG9rZW4tdmd6bngiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoiYnVpbGRlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImEyZWVlNDg3LWRlNmUtMTFlOC05Y2IyLTQyMDEwYWYwMDAyOCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpkZWZhdWx0OmJ1aWxkZXIifQ.aj1zCuMS3t7K4V1ZBDuGsyH_v909x1fw_R0fkavmNV1CRz0AFKL-e7Z6HjepTdghV9GbYks0ezSNmH_r0u6-pCDBqsQnLJpTSJlRZUwEYsFnqPi7S5k6lNhloO2MMJzMqcQqOkLCYfElzECvJkn_eRvxOTB6CJB1CSgXIUFPK10R9otWdBe34V5f7-1i5oP7UP5sLT3RWvSw45rkUoi44e_7A93YR3EJBBaZi3KKWXH_58xQCZM9W_U9sKefgxAtbfAnSqOqBHvWsOxz0tGou6sOcSKiyf7IFdRjVaTANZ_hhrmB2rRWJoHdV39WYlu0DnB_kxPbBweR8dM6L0aFuA
I1102 11:23:31.462920       1 round_trippers.go:408] Response Status: 200 OK in 5 milliseconds
I1102 11:23:31.462948       1 round_trippers.go:411] Response Headers:
I1102 11:23:31.462956       1 round_trippers.go:414]     Cache-Control: no-store
I1102 11:23:31.462964       1 round_trippers.go:414]     Content-Type: application/json
I1102 11:23:31.462972       1 round_trippers.go:414]     Content-Length: 1767
I1102 11:23:31.462980       1 round_trippers.go:414]     Date: Fri, 02 Nov 2018 11:23:31 GMT
I1102 11:23:31.463027       1 request.go:897] Response Body: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36258","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1","openshift.io/build.pod-name":"ruby22-sample-build-1-build"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a=a"},"str [truncated 743 chars]                                                                                                                                                                  
I1102 11:23:31.463372       1 request.go:897] Request Body: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36258","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1","openshift.io/build.pod-name":"ruby22-sample-build-1-build"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a=a"},"str [truncated 937 chars]                                                                                                                                                                   
I1102 11:23:31.463442       1 round_trippers.go:383] PUT https://172.30.0.1:443/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1/details
I1102 11:23:31.463454       1 round_trippers.go:390] Request Headers:
I1102 11:23:31.463463       1 round_trippers.go:393]     Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJkZWZhdWx0Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6ImJ1aWxkZXItdG9rZW4tdmd6bngiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoiYnVpbGRlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImEyZWVlNDg3LWRlNmUtMTFlOC05Y2IyLTQyMDEwYWYwMDAyOCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpkZWZhdWx0OmJ1aWxkZXIifQ.aj1zCuMS3t7K4V1ZBDuGsyH_v909x1fw_R0fkavmNV1CRz0AFKL-e7Z6HjepTdghV9GbYks0ezSNmH_r0u6-pCDBqsQnLJpTSJlRZUwEYsFnqPi7S5k6lNhloO2MMJzMqcQqOkLCYfElzECvJkn_eRvxOTB6CJB1CSgXIUFPK10R9otWdBe34V5f7-1i5oP7UP5sLT3RWvSw45rkUoi44e_7A93YR3EJBBaZi3KKWXH_58xQCZM9W_U9sKefgxAtbfAnSqOqBHvWsOxz0tGou6sOcSKiyf7IFdRjVaTANZ_hhrmB2rRWJoHdV39WYlu0DnB_kxPbBweR8dM6L0aFuA
I1102 11:23:31.463486       1 round_trippers.go:393]     Accept: application/json, */*
I1102 11:23:31.463495       1 round_trippers.go:393]     Content-Type: application/json
I1102 11:23:31.463504       1 round_trippers.go:393]     User-Agent: openshift-docker-build/v1.11.0+d4cacc0 (linux/amd64) kubernetes/d4cacc0
I1102 11:23:31.474657       1 round_trippers.go:408] Response Status: 409 Conflict in 11 milliseconds
I1102 11:23:31.474687       1 round_trippers.go:411] Response Headers:
I1102 11:23:31.474698       1 round_trippers.go:414]     Content-Type: application/json
I1102 11:23:31.474706       1 round_trippers.go:414]     Content-Length: 378
I1102 11:23:31.474713       1 round_trippers.go:414]     Date: Fri, 02 Nov 2018 11:23:31 GMT
I1102 11:23:31.474720       1 round_trippers.go:414]     Cache-Control: no-store
I1102 11:23:31.474765       1 request.go:897] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"Operation cannot be fulfilled on builds.build.openshift.io \"ruby22-sample-build-1\": the object has been modified; please apply your changes to the latest version and try again","reason":"Conflict","details":{"name":"ruby22-sample-build-1","group":"build.openshift.io","kind":"builds"},"code":409}
I1102 11:23:31.475219       1 wait.go:203] Retryable error occurred, retrying.  error: Operation cannot be fulfilled on builds.build.openshift.io "ruby22-sample-build-1": the object has been modified; please apply your changes to the latest version and try again
I1102 11:23:31.502443       1 round_trippers.go:383] GET https://172.30.0.1:443/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1
I1102 11:23:31.502478       1 round_trippers.go:390] Request Headers:
I1102 11:23:31.502488       1 round_trippers.go:393]     Accept: application/json, */*
I1102 11:23:31.502497       1 round_trippers.go:393]     User-Agent: openshift-docker-build/v1.11.0+d4cacc0 (linux/amd64) kubernetes/d4cacc0
I1102 11:23:31.502506       1 round_trippers.go:393]     Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJkZWZhdWx0Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6ImJ1aWxkZXItdG9rZW4tdmd6bngiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoiYnVpbGRlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImEyZWVlNDg3LWRlNmUtMTFlOC05Y2IyLTQyMDEwYWYwMDAyOCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpkZWZhdWx0OmJ1aWxkZXIifQ.aj1zCuMS3t7K4V1ZBDuGsyH_v909x1fw_R0fkavmNV1CRz0AFKL-e7Z6HjepTdghV9GbYks0ezSNmH_r0u6-pCDBqsQnLJpTSJlRZUwEYsFnqPi7S5k6lNhloO2MMJzMqcQqOkLCYfElzECvJkn_eRvxOTB6CJB1CSgXIUFPK10R9otWdBe34V5f7-1i5oP7UP5sLT3RWvSw45rkUoi44e_7A93YR3EJBBaZi3KKWXH_58xQCZM9W_U9sKefgxAtbfAnSqOqBHvWsOxz0tGou6sOcSKiyf7IFdRjVaTANZ_hhrmB2rRWJoHdV39WYlu0DnB_kxPbBweR8dM6L0aFuA
I1102 11:23:31.508649       1 round_trippers.go:408] Response Status: 200 OK in 6 milliseconds
I1102 11:23:31.508678       1 round_trippers.go:411] Response Headers:
I1102 11:23:31.508689       1 round_trippers.go:414]     Cache-Control: no-store
I1102 11:23:31.508697       1 round_trippers.go:414]     Content-Type: application/json
I1102 11:23:31.508705       1 round_trippers.go:414]     Content-Length: 1834
I1102 11:23:31.508713       1 round_trippers.go:414]     Date: Fri, 02 Nov 2018 11:23:31 GMT
I1102 11:23:31.508764       1 request.go:897] Response Body: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36259","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1","openshift.io/build.pod-name":"ruby22-sample-build-1-build"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a=a"},"str [truncated 810 chars]                                                                                                                                                                  
I1102 11:23:31.509147       1 request.go:897] Request Body: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36259","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1","openshift.io/build.pod-name":"ruby22-sample-build-1-build"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a=a"},"str [truncated 1004 chars]                                                                                                                                                                  
I1102 11:23:31.509210       1 round_trippers.go:383] PUT https://172.30.0.1:443/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1/details
I1102 11:23:31.509221       1 round_trippers.go:390] Request Headers:
I1102 11:23:31.509229       1 round_trippers.go:393]     Content-Type: application/json
I1102 11:23:31.509238       1 round_trippers.go:393]     Accept: application/json, */*
I1102 11:23:31.509246       1 round_trippers.go:393]     User-Agent: openshift-docker-build/v1.11.0+d4cacc0 (linux/amd64) kubernetes/d4cacc0
I1102 11:23:31.509256       1 round_trippers.go:393]     Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJkZWZhdWx0Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6ImJ1aWxkZXItdG9rZW4tdmd6bngiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoiYnVpbGRlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImEyZWVlNDg3LWRlNmUtMTFlOC05Y2IyLTQyMDEwYWYwMDAyOCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpkZWZhdWx0OmJ1aWxkZXIifQ.aj1zCuMS3t7K4V1ZBDuGsyH_v909x1fw_R0fkavmNV1CRz0AFKL-e7Z6HjepTdghV9GbYks0ezSNmH_r0u6-pCDBqsQnLJpTSJlRZUwEYsFnqPi7S5k6lNhloO2MMJzMqcQqOkLCYfElzECvJkn_eRvxOTB6CJB1CSgXIUFPK10R9otWdBe34V5f7-1i5oP7UP5sLT3RWvSw45rkUoi44e_7A93YR3EJBBaZi3KKWXH_58xQCZM9W_U9sKefgxAtbfAnSqOqBHvWsOxz0tGou6sOcSKiyf7IFdRjVaTANZ_hhrmB2rRWJoHdV39WYlu0DnB_kxPbBweR8dM6L0aFuA
I1102 11:23:31.514795       1 round_trippers.go:408] Response Status: 200 OK in 5 milliseconds
I1102 11:23:31.514824       1 round_trippers.go:411] Response Headers:
I1102 11:23:31.514832       1 round_trippers.go:414]     Cache-Control: no-store
I1102 11:23:31.514840       1 round_trippers.go:414]     Content-Type: application/json
I1102 11:23:31.514848       1 round_trippers.go:414]     Content-Length: 2036
I1102 11:23:31.514855       1 round_trippers.go:414]     Date: Fri, 02 Nov 2018 11:23:31 GMT
I1102 11:23:31.515300       1 request.go:897] Response Body: {"kind":"Build","apiVersion":"build.openshift.io/v1","metadata":{"name":"ruby22-sample-build-1","namespace":"default","selfLink":"/apis/build.openshift.io/v1/namespaces/default/builds/ruby22-sample-build-1/details","uid":"b65366ef-de91-11e8-9cb2-42010af00028","resourceVersion":"36262","creationTimestamp":"2018-11-02T11:23:24Z","labels":{"app":"ruby-helloworld-sample","buildconfig":"ruby22-sample-build","name":"ruby22-sample-build","openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.start-policy":"Serial","template":"application-template-dockerbuild"},"annotations":{"openshift.io/build-config.name":"ruby22-sample-build","openshift.io/build.number":"1","openshift.io/build.pod-name":"ruby22-sample-build-1-build"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"ruby22-sample-build","uid":"b648b848-de91-11e8-9cb2-42010af00028","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Dockerfile","dockerfile":"FROM busybox:notexist\nENV a= [truncated 1012 chars]                                                                                                                                                                 
F1102 11:23:31.515569       1 helpers.go:119] error: build error: failed to pull image: manifest for docker.io/busybox:notexist not found

Comment 30 errata-xmlrpc 2018-11-20 03:10:43 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:3537