Bug 1423420

Summary: [3.2]Failed to do custom build for error "failed to "StartContainer" for "custom-build" with ErrImagePull: "manifest unknown: manifest unknown""
Product: OpenShift Container Platform Reporter: Wenjing Zheng <wzheng>
Component: Image RegistryAssignee: Michal Fojtik <mfojtik>
Status: CLOSED WONTFIX QA Contact: Wei Sun <wsun>
Severity: medium Docs Contact:
Priority: medium    
Version: 3.2.1CC: aos-bugs, bparees
Target Milestone: ---Keywords: Regression
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-02-17 18:02:55 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Wenjing Zheng 2017-02-17 09:43:34 UTC
Description of problem:
Cannot do custom build due to "failed to "StartContainer" for "custom-build" with ErrImagePull: "manifest unknown: manifest unknown""
Events:
  FirstSeen    LastSeen    Count    From                    SubObjectPath            Type        Reason        Message
  ---------    --------    -----    ----                    -------------            --------    ------        -------
   2h        5m        32    {kubelet ip-172-18-2-97.ec2.internal}     spec.containers{custom-build}    Normal        Pulling        pulling  image  "openshift/origin-custom-docker-builder@sha256:ddde5884d3d27766ec6d888e832b23d878d41ad6e7f9c1487e631a74cbe214d6"
   2h        5m        32    {kubelet ip-172-18-2-97.ec2.internal}     spec.containers{custom-build}    Warning        Failed        Failed to  pull image  "openshift/origin-custom-docker-builder@sha256:ddde5884d3d27766ec6d888e832b23d878d41ad6e7f9c1487e631a74cbe214d6":  manifest unknown: manifest unknown
   2h        5m        32    {kubelet  ip-172-18-2-97.ec2.internal}                    Warning         FailedSync    Error syncing pod, skipping: failed to "StartContainer"  for "custom-build" with ErrImagePull: "manifest unknown: manifest  unknown"

   2h    1m    626    {kubelet ip-172-18-2-97.ec2.internal}     spec.containers{custom-build}    Normal    BackOff        Back-off  pulling image  "openshift/origin-custom-docker-builder@sha256:ddde5884d3d27766ec6d888e832b23d878d41ad6e7f9c1487e631a74cbe214d6"
   2h    1m    626    {kubelet  ip-172-18-2-97.ec2.internal}                    Warning    FailedSync     Error syncing pod, skipping: failed to "StartContainer" for  "custom-build" with ImagePullBackOff: "Back-off pulling image  \"openshift/origin-custom-docker-builder@sha256:ddde5884d3d27766ec6d888e832b23d878d41ad6e7f9c1487e631a74cbe214d6\""


Version-Release number of selected component (if applicable):
# openshift version
openshift v3.2.1.26
kubernetes v1.2.0-36-g4a3f9c5
etcd 2.2.5
# docker version
Client:
 Version:         1.10.3
 API version:     1.22
 Package version: docker-common-1.10.3-59.el7.x86_64
 Go version:      go1.6.2
 Git commit:      429be27-unsupported
 Built:           Fri Nov 18 17:03:44 2016
 OS/Arch:         linux/amd64

Server:
 Version:         1.10.3
 API version:     1.22
 Package version: docker-common-1.10.3-59.el7.x86_64
 Go version:      go1.6.2
 Git commit:      429be27-unsupported
 Built:           Fri Nov 18 17:03:44 2016
 OS/Arch:         linux/amd64


How reproducible:
always

Steps to Reproduce:
1. Create a project
2. Do custom build
$oc new-app -f https://raw.githubusercontent.com/openshift/origin/master/examples/sample-app/application-template-custombuild.json
3.

Actual results:
custom build keeps in pending status

Expected results:
Should do custom build

Additional info:
a. If use dockerimage to build directly, will meet this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1422798
b. Seems like a regression bug like this one: https://bugzilla.redhat.com/show_bug.cgi?id=1346167