Bug 1390749 - Build hung in Running state - cakephp quickstart app
Summary: Build hung in Running state - cakephp quickstart app
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Build
Version: 3.4.0
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: ---
Assignee: Cesar Wong
QA Contact: Wang Haoran
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-11-01 20:03 UTC by Vikas Laad
Modified: 2017-03-08 18:43 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Cause: The code that launches the build container in s2i was waiting indefinitely when an error occurred that was not a timeout error. Consequence: Builds that failed for some reason where hanging indefinitely in Running state. Fix: Do not wait for containers once an error is received. Result: Builds are now failing as expected and not hanging in Running state.
Clone Of:
Environment:
Last Closed: 2017-01-18 12:48:17 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2017:0066 0 normal SHIPPED_LIVE Red Hat OpenShift Container Platform 3.4 RPM Release Advisory 2017-01-18 17:23:26 UTC

Comment 2 Vikas Laad 2016-11-02 13:22:57 UTC
I do not have the env now, let me try to reproduce it and provide this info. Also the build logs were stuck without error at the git checkout step.

Comment 3 Vikas Laad 2016-11-02 14:20:10 UTC
root@ip-172-31-15-253: ~ # docker ps | grep sti                                                                                                                                                                                                                                                                             
a421ad372602        registry.ops.openshift.com/openshift3/ose-sti-builder:v3.4.0.18   "/usr/bin/openshift-s"   13 minutes ago      Up 12 minutes                           k8s_sti-build.377d8ef6_cakephp-mysql-example-4-build_p19_64c3a359-a105-11e6-a43b-024eb419e365_e5af4ce2
a60375ccbdad        registry.ops.openshift.com/openshift3/ose-sti-builder:v3.4.0.18   "/usr/bin/openshift-s"   13 minutes ago      Up 12 minutes                           k8s_sti-build.f6f58ff4_cakephp-mysql-example-4-build_p22_64e6c8de-a105-11e6-a43b-024eb419e365_b085fae5
d2d999ad84ab        registry.ops.openshift.com/openshift3/ose-sti-builder:v3.4.0.18   "/usr/bin/openshift-s"   13 minutes ago      Up 12 minutes                           k8s_sti-build.ccc88d97_cakephp-mysql-example-4-build_p0_64cc6469-a105-11e6-a43b-024eb419e365_323d429f
d3be7a837ce5        registry.ops.openshift.com/openshift3/ose-sti-builder:v3.4.0.18   "/usr/bin/openshift-s"   13 minutes ago      Up 12 minutes                           k8s_sti-build.a4688e73_cakephp-mysql-example-4-build_p20_651b3b5e-a105-11e6-a43b-024eb419e365_8412b7d8
057c8672292d        registry.ops.openshift.com/openshift3/ose-sti-builder:v3.4.0.18   "/usr/bin/openshift-s"   13 minutes ago      Up 12 minutes                           k8s_sti-build.388d8f05_cakephp-mysql-example-4-build_p8_6507e0ad-a105-11e6-a43b-024eb419e365_8dcf8caa


root@ip-172-31-15-253: ~ # docker logs a421ad372602
Cloning "https://github.com/openshift/cakephp-ex.git" ...
        Commit: fbf2cfe396fb29ce94fa52152a38d0b9599c359c (Merge pull request #47 from luciddreamz/master)
        Author: Ben Parees <bparees.github.com>
        Date:   Mon Oct 24 16:54:37 2016 -0400

Comment 4 Cesar Wong 2016-11-02 14:51:58 UTC
It looks like a hang in S2I. Here's a thread dump of a stuck container with a SIGABRT signal:

root@ip-172-31-15-253: ~ # docker logs d2d999ad84ab8718bc1915ee2cefd70f1804fac843a07a77ed440b786a75c23a
Cloning "https://github.com/openshift/cakephp-ex.git" ...
	Commit:	fbf2cfe396fb29ce94fa52152a38d0b9599c359c (Merge pull request #47 from luciddreamz/master)
	Author:	Ben Parees <bparees.github.com>
	Date:	Mon Oct 24 16:54:37 2016 -0400

SIGABRT: abort
PC=0x462dd1 m=0

goroutine 0 [idle]:
runtime.futex(0x78cb430, 0x0, 0x0, 0x0, 0x0, 0x43e320, 0x0, 0x0, 0x7ffe95c83660, 0x411cb2, ...)
	/usr/lib/golang/src/runtime/sys_linux_amd64.s:387 +0x21
runtime.futexsleep(0x78cb430, 0x0, 0xffffffffffffffff)
	/usr/lib/golang/src/runtime/os_linux.go:45 +0x62
runtime.notesleep(0x78cb430)
	/usr/lib/golang/src/runtime/lock_futex.go:145 +0x82
runtime.stopm()
	/usr/lib/golang/src/runtime/proc.go:1594 +0xad
runtime.findrunnable(0xc42001ea00, 0x0)
	/usr/lib/golang/src/runtime/proc.go:2021 +0x228
runtime.schedule()
	/usr/lib/golang/src/runtime/proc.go:2120 +0x14c
runtime.park_m(0xc420001520)
	/usr/lib/golang/src/runtime/proc.go:2183 +0x123
runtime.mcall(0x7ffe95c83800)
	/usr/lib/golang/src/runtime/asm_amd64.s:240 +0x5b

goroutine 1 [semacquire, 40 minutes]:
sync.runtime_Semacquire(0xc42061a85c)
	/usr/lib/golang/src/runtime/sema.go:47 +0x30
sync.(*WaitGroup).Wait(0xc42061a850)
	/usr/lib/golang/src/sync/waitgroup.go:131 +0x97
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti.(*STI).Execute(0xc4208b1200, 0x439b77a, 0x8, 0x0, 0x0, 0xc420c6c380, 0x0, 0x0)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti/sti.go:640 +0x8ef
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti.(*STI).Build(0xc4208b1200, 0xc420c6c380, 0x0, 0x0, 0x0)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti/sti.go:204 +0x79e
github.com/openshift/origin/pkg/build/builder.(*S2IBuilder).Build(0xc420c48f50, 0xc420c48f50, 0x78ebba8)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/pkg/build/builder/sti.go:255 +0x1c6b
github.com/openshift/origin/pkg/build/builder/cmd.s2iBuilder.Build(0x69da680, 0xc42008f3b0, 0x43fd4b5, 0x1b, 0x69d2980, 0xc4207cb260, 0xc42073a000, 0x7f4d035305a8, 0xc4207cb2c0, 0xc4206e72c0, ...)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/pkg/build/builder/cmd/builder.go:210 +0x1b9
github.com/openshift/origin/pkg/build/builder/cmd.(*s2iBuilder).Build(0x78ebba8, 0x69da680, 0xc42008f3b0, 0x43fd4b5, 0x1b, 0x69d2980, 0xc4207cb260, 0xc42073a000, 0x7f4d035305a8, 0xc4207cb2c0, ...)
	<autogenerated>:3 +0xcf
github.com/openshift/origin/pkg/build/builder/cmd.(*builderConfig).execute(0xc420c30fa0, 0x6997da0, 0x78ebba8, 0x0, 0x0)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/pkg/build/builder/cmd/builder.go:162 +0x2d5
github.com/openshift/origin/pkg/build/builder/cmd.runBuild(0x6996d20, 0xc42002c018, 0x6997da0, 0x78ebba8, 0x78ebba8, 0xc42002c018)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/pkg/build/builder/cmd/builder.go:218 +0x6a
github.com/openshift/origin/pkg/build/builder/cmd.RunS2IBuild(0x6996d20, 0xc42002c018, 0xc42002c018, 0x0)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/pkg/build/builder/cmd/builder.go:228 +0x6c
github.com/openshift/origin/pkg/cmd/infra/builder.NewCommandS2IBuilder.func1(0xc420771d40, 0xc420633150, 0x0, 0x1)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/pkg/cmd/infra/builder/builder.go:36 +0x43
github.com/openshift/origin/vendor/github.com/spf13/cobra.(*Command).execute(0xc420771d40, 0xc42000c290, 0x1, 0x1, 0xc420771d40, 0xc42000c290)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/spf13/cobra/command.go:603 +0x439
github.com/openshift/origin/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc420771d40, 0xc42002c008, 0xc42002c018, 0xc420771d40)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/spf13/cobra/command.go:689 +0x367
github.com/openshift/origin/vendor/github.com/spf13/cobra.(*Command).Execute(0xc420771d40, 0x13, 0xc420771d40)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/spf13/cobra/command.go:648 +0x2b
main.main()
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/cmd/openshift/openshift.go:33 +0x165

goroutine 17 [syscall, 42 minutes, locked to thread]:
runtime.goexit()
	/usr/lib/golang/src/runtime/asm_amd64.s:2086 +0x1

goroutine 5 [chan receive]:
github.com/openshift/origin/vendor/github.com/golang/glog.(*loggingT).flushDaemon(0x78c9fc0)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/golang/glog/glog.go:879 +0x7a
created by github.com/openshift/origin/vendor/github.com/golang/glog.init.1
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/golang/glog/glog.go:410 +0x21d

goroutine 7 [syscall, 42 minutes]:
os/signal.signal_recv(0xd40003)
	/usr/lib/golang/src/runtime/sigqueue.go:116 +0x157
os/signal.loop()
	/usr/lib/golang/src/os/signal/signal_unix.go:22 +0x22
created by os/signal.init.1
	/usr/lib/golang/src/os/signal/signal_unix.go:28 +0x41

goroutine 111 [chan receive]:
github.com/openshift/origin/vendor/github.com/coreos/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc420362100)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/coreos/etcd/pkg/logutil/merge_logger.go:174 +0x94
created by github.com/openshift/origin/vendor/github.com/coreos/etcd/pkg/logutil.NewMergeLogger
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/coreos/etcd/pkg/logutil/merge_logger.go:92 +0xd2

goroutine 98 [chan receive]:
github.com/openshift/origin/vendor/github.com/coreos/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc420351060)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/coreos/etcd/pkg/logutil/merge_logger.go:174 +0x94
created by github.com/openshift/origin/vendor/github.com/coreos/etcd/pkg/logutil.NewMergeLogger
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/coreos/etcd/pkg/logutil/merge_logger.go:92 +0xd2

goroutine 88 [select]:
github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/util/wait.JitterUntil(0x488bb40, 0x12a05f200, 0x0, 0x14c4e01, 0xc420062120)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/util/wait/wait.go:100 +0x16e
github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/util/wait.Until(0x488bb40, 0x12a05f200, 0xc420062120)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/util/wait/wait.go:49 +0x4d
created by github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/util/logs.InitLogs
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/util/logs/logs.go:50 +0xa8

goroutine 91 [IO wait, 42 minutes]:
net.runtime_pollWait(0x7f4d03531580, 0x72, 0x4)
	/usr/lib/golang/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420c49800, 0x72, 0xc420ac39d0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420c49800, 0x699e7e0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420c497a0, 0xc420831000, 0x1000, 0x1000, 0x0, 0x699e7e0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc42002c4a8, 0xc420831000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc4207a4d00, 0xc420831000, 0x1000, 0x1000, 0xec0200, 0xc420ac3b58, 0x4070dd)
	/usr/lib/golang/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420c7baa0)
	/usr/lib/golang/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420c7baa0, 0x1, 0xc420ac3bbd, 0x1, 0x0, 0xc4206842a0, 0x0)
	/usr/lib/golang/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc4207a4d00)
	/usr/lib/golang/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
	/usr/lib/golang/src/net/http/transport.go:1062 +0x4e9

goroutine 92 [select, 42 minutes]:
net/http.(*persistConn).writeLoop(0xc4207a4d00)
	/usr/lib/golang/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
	/usr/lib/golang/src/net/http/transport.go:1063 +0x50e

goroutine 73 [IO wait, 42 minutes]:
net.runtime_pollWait(0x7f4d035314c0, 0x72, 0x6)
	/usr/lib/golang/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4209a04c0, 0x72, 0xc42003d9d0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4209a04c0, 0x699e7e0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4209a0460, 0xc420c64000, 0x1000, 0x1000, 0x0, 0x699e7e0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420088268, 0xc420c64000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42026a200, 0xc420c64000, 0x1000, 0x1000, 0xec0200, 0xc42003db58, 0x4070dd)
	/usr/lib/golang/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420960ae0)
	/usr/lib/golang/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420960ae0, 0x1, 0xc42003dbbd, 0x1, 0x0, 0xc420684a80, 0x0)
	/usr/lib/golang/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42026a200)
	/usr/lib/golang/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
	/usr/lib/golang/src/net/http/transport.go:1062 +0x4e9

goroutine 74 [select, 42 minutes]:
net/http.(*persistConn).writeLoop(0xc42026a200)
	/usr/lib/golang/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
	/usr/lib/golang/src/net/http/transport.go:1063 +0x50e

goroutine 160 [select, 42 minutes]:
net/http.(*persistConn).writeLoop(0xc42026a500)
	/usr/lib/golang/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
	/usr/lib/golang/src/net/http/transport.go:1063 +0x50e

goroutine 159 [IO wait, 42 minutes]:
net.runtime_pollWait(0x7f4d03531340, 0x72, 0x8)
	/usr/lib/golang/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420963db0, 0x72, 0xc420abc6f0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420963db0, 0x699e7e0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420963d50, 0xc4207e2400, 0x400, 0x400, 0x0, 0x699e7e0, 0xc42001a140)
	/usr/lib/golang/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420172400, 0xc4207e2400, 0x400, 0x400, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/net/net.go:173 +0x70
crypto/tls.(*block).readFromUntil(0xc4206c2390, 0x6996060, 0xc420172400, 0x5, 0xc420172400, 0x28)
	/usr/lib/golang/src/crypto/tls/conn.go:476 +0x91
crypto/tls.(*Conn).readRecord(0xc4204b4a80, 0x4896917, 0xc4204b4b88, 0xc4200001a0)
	/usr/lib/golang/src/crypto/tls/conn.go:578 +0xc4
crypto/tls.(*Conn).Read(0xc4204b4a80, 0xc4204ee000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/crypto/tls/conn.go:1113 +0x116
net/http.(*persistConn).Read(0xc42026a500, 0xc4204ee000, 0x1000, 0x1000, 0xec0200, 0xc420abcb58, 0x4070dd)
	/usr/lib/golang/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420685e60)
	/usr/lib/golang/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420685e60, 0x1, 0xc420abcbbd, 0x1, 0x0, 0xc420685ec0, 0x0)
	/usr/lib/golang/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42026a500)
	/usr/lib/golang/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
	/usr/lib/golang/src/net/http/transport.go:1062 +0x4e9

goroutine 188 [semacquire, 42 minutes]:
sync.runtime_notifyListWait(0xc4202e67f8, 0xc400000000)
	/usr/lib/golang/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc4202e67e8)
	/usr/lib/golang/src/sync/cond.go:57 +0x80
io.(*pipe).write(0xc4202e6780, 0xc4207aadb3, 0x200, 0x200, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/io/pipe.go:89 +0x191
io.(*PipeWriter).Write(0xc420088e68, 0xc4207aadb3, 0x200, 0x200, 0x78ed6e0, 0x0, 0x5)
	/usr/lib/golang/src/io/pipe.go:156 +0x4c
archive/tar.(*Writer).writeHeader(0xc4207aad80, 0xc4207c7450, 0x1, 0x2, 0xc4207c7450)
	/usr/lib/golang/src/archive/tar/writer.go:270 +0x86e
archive/tar.(*Writer).WriteHeader(0xc4207aad80, 0xc4207c7450, 0x17, 0xc4204d2180)
	/usr/lib/golang/src/archive/tar/writer.go:134 +0x3a
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/tar.(*stiTar).writeTarHeader(0xc42063b1c0, 0xc4207aad80, 0xc4206d5820, 0x1e, 0xc420610810, 0x2f, 0x69ce480, 0xc4207c7380, 0xc420610800, 0x0, ...)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/tar/tar.go:321 +0x2a4
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/tar.(*stiTar).CreateTarStreamWithLogging.func1(0xc420610810, 0x2f, 0x69ce480, 0xc4207c7380, 0x0, 0x0, 0x0, 0x0)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/tar/tar.go:274 +0x6b5
path/filepath.walk(0xc420610810, 0x2f, 0x69ce480, 0xc4207c7380, 0xc420736500, 0x0, 0x0)
	/usr/lib/golang/src/path/filepath/path.go:351 +0x81
path/filepath.walk(0xc420610720, 0x26, 0x69ce480, 0xc4207c72b0, 0xc420736500, 0x0, 0x0)
	/usr/lib/golang/src/path/filepath/path.go:376 +0x344
path/filepath.walk(0xc4206d5820, 0x1e, 0x69ce480, 0xc4207c71e0, 0xc420736500, 0x0, 0x1)
	/usr/lib/golang/src/path/filepath/path.go:376 +0x344
path/filepath.Walk(0xc4206d5820, 0x1e, 0xc420736500, 0xc4205cce30, 0x1)
	/usr/lib/golang/src/path/filepath/path.go:398 +0xd5
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/tar.(*stiTar).CreateTarStreamWithLogging(0xc42063b1c0, 0xc4206d5820, 0x1e, 0xc420b57700, 0x6995ce0, 0xc420088e68, 0x0, 0x0, 0x0, 0x0)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/tar/tar.go:284 +0x2b3
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/tar.(*stiTar).CreateTarStream(0xc42063b1c0, 0xc4206d5820, 0x1e, 0xc420b57700, 0x6995ce0, 0xc420088e68, 0x547364613434526a, 0x6465666466317156)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/tar/tar.go:239 +0x78
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti.(*STI).Execute.func3(0xc42061a850, 0xc420459860, 0xc42061a840, 0xc420088e68, 0xc4208b1200, 0xc4206d5820, 0x1e)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti/sti.go:597 +0x208
created by github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti.(*STI).Execute
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti/sti.go:598 +0xb51

goroutine 189 [semacquire, 42 minutes]:
sync.runtime_notifyListWait(0xc4202e6640, 0x0)
	/usr/lib/golang/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc4202e6630)
	/usr/lib/golang/src/sync/cond.go:57 +0x80
io.(*pipe).read(0xc4202e6600, 0xc4207d0000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/io/pipe.go:47 +0x102
io.(*PipeReader).Read(0xc420088e40, 0xc4207d0000, 0x1000, 0x1000, 0x1, 0x0, 0x0)
	/usr/lib/golang/src/io/pipe.go:129 +0x4c
bufio.(*Reader).fill(0xc420039ed8)
	/usr/lib/golang/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).ReadSlice(0xc420039ed8, 0xc420b55d0a, 0x4a6289, 0xc4204ccb28, 0xc420386000, 0x0, 0x0)
	/usr/lib/golang/src/bufio/bufio.go:330 +0xb5
bufio.(*Reader).ReadBytes(0xc420039ed8, 0xa, 0xc420b55e70, 0x1846681, 0xc420826360, 0x794d414100000000, 0x0)
	/usr/lib/golang/src/bufio/bufio.go:408 +0x66
bufio.(*Reader).ReadString(0xc420039ed8, 0xa, 0x0, 0x0, 0x1000, 0x1000)
	/usr/lib/golang/src/bufio/bufio.go:448 +0x38
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti.(*STI).Execute.func4(0xc420c6c380, 0x6995ca0, 0xc420088e40)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti/sti.go:608 +0xe0
created by github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti.(*STI).Execute
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti/sti.go:626 +0x76e

goroutine 190 [semacquire, 42 minutes]:
sync.runtime_notifyListWait(0xc4202e6700, 0x0)
	/usr/lib/golang/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc4202e66f0)
	/usr/lib/golang/src/sync/cond.go:57 +0x80
io.(*pipe).read(0xc4202e66c0, 0xc4207d1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/io/pipe.go:47 +0x102
io.(*PipeReader).Read(0xc420088e50, 0xc4207d1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/io/pipe.go:129 +0x4c
bufio.(*Reader).fill(0xc42003aed0)
	/usr/lib/golang/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).ReadSlice(0xc42003aed0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/bufio/bufio.go:330 +0xb5
bufio.(*Reader).ReadBytes(0xc42003aed0, 0x3aa1e0a, 0x1, 0xc4207d1000, 0x0, 0x0, 0x0)
	/usr/lib/golang/src/bufio/bufio.go:408 +0x66
bufio.(*Reader).ReadString(0xc42003aed0, 0x100a, 0x1000, 0xc4207d1000, 0x1000, 0x1000)
	/usr/lib/golang/src/bufio/bufio.go:448 +0x38
github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/docker.StreamContainerIO(0x6995ca0, 0xc420088e50, 0xc42061a830, 0x488cb48)
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/docker/util.go:165 +0xa8
created by github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti.(*STI).Execute
	/builddir/build/BUILD/atomic-openshift-git-0.ada983f/_output/local/go/src/github.com/openshift/origin/vendor/github.com/openshift/source-to-image/pkg/build/strategies/sti/sti.go:628 +0x7b8

rax    0xca
rbx    0x78ca4d0
rcx    0xffffffffffffffff
rdx    0x0
rdi    0x78cb430
rsi    0x0
rbp    0x7ffe95c83630
rsp    0x7ffe95c835e8
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0xc420062168
r13    0x0
r14    0xc420062120
r15    0x0
rip    0x462dd1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

Comment 5 Cesar Wong 2016-11-03 13:28:54 UTC
PR to s2i repo: https://github.com/openshift/source-to-image/pull/631

Comment 6 Cesar Wong 2016-11-09 15:32:06 UTC
Fix delivered to origin with https://github.com/openshift/origin/pull/11753

Comment 7 Troy Dawson 2016-11-09 19:56:15 UTC
This has been merged into ose and is in OSE v3.4.0.24 or newer.

Comment 9 Dongbo Yan 2016-11-10 14:07:50 UTC
I try to reproduce this issue on openshift v3.4.0.23+24b1a58, I have created 10 projects, and trigger 8 builds per project. But every build pod will be complete.
Could you please provide some specific recreate steps, thx

Comment 10 Vikas Laad 2016-11-10 14:17:25 UTC
Please try with openshift v3.4.0.18+ada983f version. I was able to reproduce it many times with this version when I created this bug.

Comment 11 Wang Haoran 2016-11-15 05:18:06 UTC
Verified with:
openshift v3.4.0.25+1f36858
kubernetes v1.4.0+776c994
etcd 3.1.0-rc.0

Comment 13 errata-xmlrpc 2017-01-18 12:48:17 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:0066


Note You need to log in before you can comment on or make changes to this bug.