Bug 1337256

Summary: Build Failed on dev-preview-stage
Product: OpenShift Online Reporter: Diógenes Rettori <drettori>
Component: Image RegistryAssignee: Michal Minar <miminar>
Status: CLOSED INSUFFICIENT_DATA QA Contact: Wei Sun <wsun>
Severity: high Docs Contact:
Priority: high    
Version: 3.xCC: abhgupta, aos-bugs, dakini, drettori, maszulik, mfojtik, pweil
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-07-21 20:51:09 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Diógenes Rettori 2016-05-18 15:48:00 UTC
Description of problem:

Build failed on dev-preview-stage.

I was trying my 'never-ending-builds' scenario where a build is trigger as the result of an image that was pushed on the previous build.

logs below

I0518 11:35:33.091966       1 builder.go:57] Master version "v3.2.0.44", Builder version "v3.2.0.44"
I0518 11:35:33.112080       1 builder.go:145] Running build with cgroup limits: api.CGroupLimits{MemoryLimitBytes:536870912, CPUShares:61, CPUPeriod:100000, CPUQuota:100000, MemorySwap:536870912}
I0518 11:35:33.127250       1 sti.go:206] The value of ALLOWED_UIDS is [1-]
I0518 11:35:33.127283       1 sti.go:214] The value of DROP_CAPS is [KILL,MKNOD,SETGID,SETUID,SYS_CHROOT]
I0518 11:35:33.138668       1 docker.go:351] Image "172.30.46.234:5000/project/eap-app@sha256:289b13df7d9dbe4b14ccc5aaf652b244b3a60f47e618f84a18fdd57329daba5c" not available locally, pulling ...
I0518 11:35:33.138700       1 docker.go:373] Pulling Docker image 172.30.46.234:5000/project/eap-app@sha256:289b13df7d9dbe4b14ccc5aaf652b244b3a60f47e618f84a18fdd57329daba5c ...
I0518 11:35:35.225247       1 sti.go:233] Creating a new S2I builder with build config: "Builder Name:\t\t\tproject/eap-app-8:fa4b9a3e\nBuilder Image:\t\t\t172.30.46.234:5000/project/eap-app@sha256:289b13df7d9dbe4b14ccc5aaf652b244b3a60f47e618f84a18fdd57329daba5c\nSource:\t\t\t\tfile:///tmp/s2i-build408188347/upload/src#6.4.x\nContext Directory:\t\tkitchensink\nOutput Image Tag:\t\tproject/eap-app-9:d0a6ab8a\nEnvironment:\t\t\tOPENSHIFT_BUILD_NAME=eap-app-9,OPENSHIFT_BUILD_NAMESPACE=project,OPENSHIFT_BUILD_SOURCE=https://github.com/jboss-developer/jboss-eap-quickstarts.git,OPENSHIFT_BUILD_REFERENCE=6.4.x\nIncremental Build:\t\tdisabled\nRemove Old Build:\t\tdisabled\nBuilder Pull Policy:\t\tif-not-present\nPrevious Image Pull Policy:\talways\nQuiet:\t\t\t\tdisabled\nLayered Build:\t\t\tdisabled\nWorkdir:\t\t\t/tmp/s2i-build408188347\nDocker NetworkMode:\t\tcontainer:4f897185de3626449420ffa29e4a101684e54dfe32707c4e34be266d8c845c26\nDocker Endpoint:\t\tunix:///var/run/docker.sock\nDocker Pull Config:\t\t/var/run/secrets/openshift.io/pull\nDocker Pull User:\t\tserviceaccount\n"
I0518 11:35:35.231814       1 docker.go:355] Using locally available image "172.30.46.234:5000/project/eap-app@sha256:289b13df7d9dbe4b14ccc5aaf652b244b3a60f47e618f84a18fdd57329daba5c"
I0518 11:35:35.249669       1 docker.go:355] Using locally available image "172.30.46.234:5000/project/eap-app@sha256:289b13df7d9dbe4b14ccc5aaf652b244b3a60f47e618f84a18fdd57329daba5c"
I0518 11:35:35.249706       1 docker.go:475] Image contains io.openshift.s2i.scripts-url set to 'image:///usr/local/s2i'
I0518 11:35:35.249760       1 sti.go:140] Preparing to build project/eap-app-9:d0a6ab8a
I0518 11:35:35.253616       1 source.go:197] Downloading "https://github.com/jboss-developer/jboss-eap-quickstarts.git" ...
I0518 11:35:35.616474       1 source.go:208] Cloning source from https://github.com/jboss-developer/jboss-eap-quickstarts.git
I0518 11:35:41.558930       1 install.go:251] Using "assemble" installed from "image:///usr/local/s2i/assemble"
I0518 11:35:41.558992       1 install.go:251] Using "run" installed from "image:///usr/local/s2i/run"
I0518 11:35:41.559014       1 install.go:251] Using "save-artifacts" installed from "image:///usr/local/s2i/save-artifacts"
I0518 11:35:41.559041       1 sti.go:152] Clean build will be performed
I0518 11:35:41.559047       1 sti.go:155] Performing source build from file:///tmp/s2i-build408188347/upload/src#6.4.x
I0518 11:35:41.559053       1 sti.go:166] Running "assemble" in "project/eap-app-9:d0a6ab8a"
I0518 11:35:41.559061       1 sti.go:441] Using image name 172.30.46.234:5000/project/eap-app@sha256:289b13df7d9dbe4b14ccc5aaf652b244b3a60f47e618f84a18fdd57329daba5c
I0518 11:35:41.559074       1 sti.go:445] No user environment provided (no environment file found in application sources)
I0518 11:35:41.559148       1 sti.go:547] starting the source uploading ...
I0518 11:35:41.565969       1 docker.go:475] Image contains io.openshift.s2i.scripts-url set to 'image:///usr/local/s2i'
I0518 11:35:41.565996       1 docker.go:529] Base directory for STI scripts is '/usr/local/s2i'. Untarring destination is '/tmp'.
I0518 11:35:41.566007       1 docker.go:599] Creating container with options {Name:"" Config:&{Hostname: Domainname: User: Memory:0 MemorySwap:0 MemoryReservation:0 KernelMemory:0 CPUShares:0 CPUSet: AttachStdin:false AttachStdout:true AttachStderr:false PortSpecs:[] ExposedPorts:map[] StopSignal: Tty:false OpenStdin:true StdinOnce:true Env:[OPENSHIFT_BUILD_NAME=eap-app-9 OPENSHIFT_BUILD_NAMESPACE=project OPENSHIFT_BUILD_SOURCE=https://github.com/jboss-developer/jboss-eap-quickstarts.git OPENSHIFT_BUILD_REFERENCE=6.4.x] Cmd:[/bin/sh -c tar -C /tmp -xf - && /usr/local/s2i/assemble] DNS:[] Image:172.30.46.234:5000/project/eap-app@sha256:289b13df7d9dbe4b14ccc5aaf652b244b3a60f47e618f84a18fdd57329daba5c Volumes:map[] VolumeDriver: VolumesFrom: WorkingDir: MacAddress: Entrypoint:[] NetworkDisabled:false SecurityOpts:[] OnBuild:[] Mounts:[] Labels:map[]} HostConfig:&{Binds:[] CapAdd:[] CapDrop:[KILL MKNOD SETGID SETUID SYS_CHROOT] GroupAdd:[] ContainerIDFile: LxcConf:[] Privileged:false PortBindings:map[] Links:[] PublishAllPorts:false DNS:[] DNSOptions:[] DNSSearch:[] ExtraHosts:[] VolumesFrom:[] NetworkMode:container:4f897185de3626449420ffa29e4a101684e54dfe32707c4e34be266d8c845c26 IpcMode: PidMode: UTSMode: RestartPolicy:{Name: MaximumRetryCount:0} Devices:[] LogConfig:{Type: Config:map[]} ReadonlyRootfs:false SecurityOpt:[] CgroupParent: Memory:536870912 MemorySwap:536870912 MemorySwappiness:0 OOMKillDisable:false CPUShares:61 CPUSet: CPUSetCPUs: CPUSetMEMs: CPUQuota:100000 CPUPeriod:100000 BlkioWeight:0 Ulimits:[] VolumeDriver: OomScoreAdj:0}} ...
I0518 11:35:42.227273       1 docker.go:622] Attaching to container "0f5fb85cecaf1c5db02e5a000e520123338b2fc3ac34ba6020a1b533eecd6a54" ...
I0518 11:35:42.227672       1 docker.go:631] Starting container "0f5fb85cecaf1c5db02e5a000e520123338b2fc3ac34ba6020a1b533eecd6a54" ...
Found pom.xml... attempting to build with 'mvn -e -Popenshift -DskipTests -Dcom.redhat.xpaas.repo.redhatga package -Djava.net.preferIPv4Stack=true '
E0518 11:35:42.726004       1 util.go:91] Picked up JAVA_TOOL_OPTIONS: -Duser.home=/home/jboss -Duser.name=jboss
Using Apache Maven 3.0.5 (Red Hat 3.0.5-16)
Maven home: /usr/share/maven
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-0.b14.el7_2.x86_64/jre
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "3.10.0-327.13.1.el7.x86_64", arch: "amd64", family: "unix"
E0518 11:35:43.009162       1 util.go:91] Picked up JAVA_TOOL_OPTIONS: -Duser.home=/home/jboss -Duser.name=jboss
[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building JBoss EAP Quickstart: kitchensink 6.4.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ jboss-kitchensink ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ jboss-kitchensink ---
[INFO] Compiling 8 source files to /home/jboss/source/target/classes
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ jboss-kitchensink ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ jboss-kitchensink ---
[INFO] Compiling 1 source file to /home/jboss/source/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.10:test (default-test) @ jboss-kitchensink ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-war-plugin:2.1.1:war (default-war) @ jboss-kitchensink ---
[INFO] Packaging webapp
[INFO] Assembling webapp [jboss-kitchensink] in [/home/jboss/source/target/jboss-kitchensink]
[INFO] Processing war project
[INFO] Copying webapp resources [/home/jboss/source/src/main/webapp]
[INFO] Webapp assembled in [196 msecs]
[INFO] Building war: /home/jboss/source/deployments/ROOT.war
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 11.184s
[INFO] Finished at: Wed May 18 11:35:56 EDT 2016
[INFO] Final Memory: 22M/464M
[INFO] ------------------------------------------------------------------------
Copying all war artifacts from /home/jboss/source/target directory into /opt/eap/standalone/deployments for later deployment...
Copying all ear artifacts from /home/jboss/source/target directory into /opt/eap/standalone/deployments for later deployment...
Copying all rar artifacts from /home/jboss/source/target directory into /opt/eap/standalone/deployments for later deployment...
Copying all jar artifacts from /home/jboss/source/target directory into /opt/eap/standalone/deployments for later deployment...
Copying all war artifacts from /home/jboss/source/deployments directory into /opt/eap/standalone/deployments for later deployment...
'/home/jboss/source/deployments/ROOT.war' -> '/opt/eap/standalone/deployments/ROOT.war'
Copying all ear artifacts from /home/jboss/source/deployments directory into /opt/eap/standalone/deployments for later deployment...
Copying all rar artifacts from /home/jboss/source/deployments directory into /opt/eap/standalone/deployments for later deployment...
Copying all jar artifacts from /home/jboss/source/deployments directory into /opt/eap/standalone/deployments for later deployment...
I0518 11:35:57.102767       1 docker.go:689] Invoking postExecution function
E0518 11:35:57.102780       1 sti.go:571] Error reading docker stdout, EOF
I0518 11:35:57.102856       1 sti.go:289] No user environment provided (no environment file found in application sources)
I0518 11:35:57.126597       1 docker.go:734] Committing container with dockerOpts: {Container:0f5fb85cecaf1c5db02e5a000e520123338b2fc3ac34ba6020a1b533eecd6a54 Repository:project/eap-app-9 Tag:d0a6ab8a Message: Author: Run:0xc208812380}, config: {Hostname: Domainname: User:185 Memory:0 MemorySwap:0 MemoryReservation:0 KernelMemory:0 CPUShares:0 CPUSet: AttachStdin:false AttachStdout:false AttachStderr:false PortSpecs:[] ExposedPorts:map[] StopSignal: Tty:false OpenStdin:false StdinOnce:false Env:[OPENSHIFT_BUILD_NAME=eap-app-9 OPENSHIFT_BUILD_NAMESPACE=project OPENSHIFT_BUILD_SOURCE=https://github.com/jboss-developer/jboss-eap-quickstarts.git OPENSHIFT_BUILD_REFERENCE=6.4.x] Cmd:[/usr/local/s2i/run] DNS:[] Image: Volumes:map[] VolumeDriver: VolumesFrom: WorkingDir: MacAddress: Entrypoint:[] NetworkDisabled:false SecurityOpts:[] OnBuild:[] Mounts:[] Labels:map[build-date:2016-04-22T09:36:00.362878Z io.openshift.build.image:172.30.46.234:5000/project/eap-app@sha256:289b13df7d9dbe4b14ccc5aaf652b244b3a60f47e618f84a18fdd57329daba5c Release:13 distribution-scope:public com.redhat.dev-mode.port:DEBUG_PORT:8787 io.k8s.display-name:project/eap-app-9:d0a6ab8a Name:jboss-eap-6/eap64-openshift io.openshift.build.source-location:https://github.com/jboss-developer/jboss-eap-quickstarts.git Build_Host:rcm-img-docker02.build.eng.bos.redhat.com com.redhat.deployments-dir:/opt/eap/standalone/deployments io.openshift.expose-services:8080:http io.openshift.tags:builder,javaee,eap,eap6 io.k8s.description:Platform for building and running JavaEE applications on JBoss EAP 6.4 io.openshift.build.commit.ref:6.4.x Architecture:x86_64 Authoritative_Registry:registry.access.redhat.com vcs-type:git architecture:x86_64 io.openshift.s2i.scripts-url:image:///usr/local/s2i Vendor:Red Hat, Inc. org.jboss.deployments-dir:/opt/eap/standalone/deployments vcs-ref:b6301ee70cb5e0d38f4a533ed983e05c7bd05383 io.openshift.build.commit.date:Mon Sep 21 14:55:29 2015 -0600 BZComponent:jboss-eap-6-eap64-openshift-docker io.openshift.build.commit.author:Jason Po
rter <lightguard.jp> io.openshift.build.commit.message:Update README.md io.openshift.build.commit.id:8d9b0b373f688a1d04ad50fea78e349721f4da62 Version:1.3 com.redhat.dev-mode:DEBUG:true io.openshift.build.source-context-dir:kitchensink]}
I0518 11:36:11.135295       1 sti.go:334] Successfully built project/eap-app-9:d0a6ab8a
I0518 11:36:11.171619       1 cleanup.go:23] Removing temporary directory /tmp/s2i-build408188347
I0518 11:36:11.171665       1 fs.go:156] Removing directory '/tmp/s2i-build408188347'
I0518 11:36:11.303836       1 sti.go:268] Using provided push secret for pushing 172.30.46.234:5000/project/eap-app:latest image
I0518 11:36:11.303891       1 sti.go:272] Pushing 172.30.46.234:5000/project/eap-app:latest image ...
I0518 11:36:32.178340       1 sti.go:277] Registry server Address: 
I0518 11:36:32.178376       1 sti.go:278] Registry server User Name: serviceaccount
I0518 11:36:32.178384       1 sti.go:279] Registry server Email: serviceaccount
I0518 11:36:32.178392       1 sti.go:284] Registry server Password: <<non-empty>>
F0518 11:36:32.178400       1 builder.go:204] Error: build error: Failed to push image. Response from registry is: Error parsing HTTP response: unexpected end of JSON input: ""

Comment 1 Ben Parees 2016-05-18 15:52:36 UTC
Guessing the registry team will need ops to gather the registry logs to diagnose this.

Comment 10 Abhishek Gupta 2016-07-21 20:51:09 UTC
Closing this for now since we do not have logs for this particular incident. Please reopen if you hit this issue again and we'll request Ops to fetch the logs for debugging.