Attachment 1446537 Details for Bug 1584995 – logs from the api pod

logs from the api pod

logs-from-api-pod (text/plain), 59.44 KB, created by zhou ying on 2018-06-01 06:21:31 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: zhou ying

Created: 2018-06-01 06:21:31 UTC

Size: 59.44 KB

patch

obsolete

>
>logging error output: "[+]ping ok\n[-]etcd failed: reason withheld\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/project.openshift.io-projectcache ok\n[+]poststarthook/project.openshift.io-projectauthorizationcache ok\n[+]poststarthook/security.openshift.io-bootstrapscc ok\n[+]poststarthook/bootstrap-controller ok\n[+]poststarthook/ca-registration ok\n[+]poststarthook/start-kube-aggregator-informers ok\n[+]poststarthook/apiservice-registration-controller ok\n[+]poststarthook/apiservice-status-available-controller ok\n[+]poststarthook/apiservice-openapi-controller ok\n[+]poststarthook/kube-apiserver-autoregistration ok\n[+]autoregister-completion ok\n[+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok\n[+]poststarthook/authorization.openshift.io-ensureopenshift-infra ok\n[+]poststarthook/quota.openshift.io-clusterquotamapping ok\n[+]poststarthook/openshift.io-AdmissionInit ok\n[+]poststarthook/openshift.io-StartInformers ok\n[+]poststarthook/oauth.openshift.io-StartOAuthClientsBootstrapping ok\nhealthz check failed\n"
> [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/shared-informers] 172.16.120.27:55424]
>I0601 05:17:20.942029       1 handler.go:159] kube-aggregator: GET "/healthz" satisfied by nonGoRestful
>I0601 05:17:20.942051       1 pathrecorder.go:240] kube-aggregator: "/healthz" satisfied by exact match
>I0601 05:17:21.386394       1 handler.go:159] kube-aggregator: GET "/healthz/ready" satisfied by nonGoRestful
>I0601 05:17:21.386413       1 pathrecorder.go:253] kube-aggregator: "/healthz/ready" satisfied by NotFoundHandler
>I0601 05:17:21.386421       1 handler.go:159] kube-apiserver: GET "/healthz/ready" satisfied by nonGoRestful
>I0601 05:17:21.386426       1 pathrecorder.go:253] kube-apiserver: "/healthz/ready" satisfied by NotFoundHandler
>I0601 05:17:21.386432       1 handler.go:159] openshift-apiserver: GET "/healthz/ready" satisfied by nonGoRestful
>I0601 05:17:21.386437       1 pathrecorder.go:240] openshift-apiserver: "/healthz/ready" satisfied by exact match
>I0601 05:17:21.386457       1 wrap.go:42] GET /healthz/ready: (208.01Âµs) 200 [[kube-probe/1.10+] 172.16.120.27:59460]
>I0601 05:17:21.445594       1 handler.go:159] kube-aggregator: GET "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by nonGoRestful
>I0601 05:17:21.445614       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by prefix /api/
>I0601 05:17:21.445622       1 handler.go:149] kube-apiserver: GET "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by gorestful with webservice /api/v1
>I0601 05:17:21.446836       1 wrap.go:42] GET /api/v1/namespaces/kube-system/configmaps/kube-scheduler: (1.440276ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:21.447597       1 handler.go:159] kube-aggregator: PUT "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by nonGoRestful
>I0601 05:17:21.447615       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by prefix /api/
>I0601 05:17:21.447623       1 handler.go:149] kube-apiserver: PUT "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by gorestful with webservice /api/v1
>I0601 05:17:21.449587       1 wrap.go:42] PUT /api/v1/namespaces/kube-system/configmaps/kube-scheduler: (2.192441ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:21.901549       1 handler.go:159] kube-aggregator: GET "/healthz" satisfied by nonGoRestful
>I0601 05:17:21.901574       1 pathrecorder.go:240] kube-aggregator: "/healthz" satisfied by exact match
>I0601 05:17:21.942466       1 wrap.go:42] GET /healthz?timeout=32s: (41.153653ms) 500
>goroutine 26160 [running]:
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).recordStatus(0xc427b99030, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:207 +0xdd
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).WriteHeader(0xc427b99030, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:186 +0x35
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*baseTimeoutWriter).WriteHeader(0xc42013c680, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:188 +0xac
>net/http.Error(0x7f3dea8f5da8, 0xc433c31940, 0xc42c8ec480, 0x46c, 0x1f4)
>	/usr/lib/golang/src/net/http/server.go:1930 +0xda
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz.handleRootHealthz.func1(0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz/healthz.go:130 +0x508
>net/http.HandlerFunc.ServeHTTP(0xc4355a08c0, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc42e320a80, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:241 +0x55a
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc42828d2d0, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0xa1
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x5a4d0f6, 0xf, 0xc42cfcf7a0, 0xc42828d2d0, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/handler.go:160 +0x6ad
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.(*director).ServeHTTP(0xc42c6c4be0, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	<autogenerated>:1 +0x75
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:52 +0x37d
>net/http.HandlerFunc.ServeHTTP(0xc428774f00, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:165 +0x42a
>net/http.HandlerFunc.ServeHTTP(0xc42a8aa200, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:49 +0x203a
>net/http.HandlerFunc.ServeHTTP(0xc428774fa0, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:78 +0x2b1
>net/http.HandlerFunc.ServeHTTP(0xc428775040, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request.WithRequestContext.func1(0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request/requestcontext.go:110 +0xcb
>net/http.HandlerFunc.ServeHTTP(0xc42c6c4cc0, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithCORS.func1(0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/cors.go:75 +0x17b
>net/http.HandlerFunc.ServeHTTP(0xc42c11dc80, 0x7f3dea8f5da8, 0xc433c31940, 0xc439ecb400)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc42c6c5120, 0xaca4fe0, 0xc433c31940, 0xc439ecb400, 0xc42a5e3bc0)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:93 +0x8d
>created by github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x1ab
>
>logging error output: "[+]ping ok\n[-]etcd failed: reason withheld\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/project.openshift.io-projectcache ok\n[+]poststarthook/project.openshift.io-projectauthorizationcache ok\n[+]poststarthook/security.openshift.io-bootstrapscc ok\n[+]poststarthook/bootstrap-controller ok\n[+]poststarthook/ca-registration ok\n[+]poststarthook/start-kube-aggregator-informers ok\n[+]poststarthook/apiservice-registration-controller ok\n[+]poststarthook/apiservice-status-available-controller ok\n[+]poststarthook/apiservice-openapi-controller ok\n[+]poststarthook/kube-apiserver-autoregistration ok\n[+]autoregister-completion ok\n[+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok\n[+]poststarthook/authorization.openshift.io-ensureopenshift-infra ok\n[+]poststarthook/quota.openshift.io-clusterquotamapping ok\n[+]poststarthook/openshift.io-AdmissionInit ok\n[+]poststarthook/openshift.io-StartInformers ok\n[+]poststarthook/oauth.openshift.io-StartOAuthClientsBootstrapping ok\nhealthz check failed\n"
> [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:55424]
>I0601 05:17:21.942966       1 wrap.go:42] GET /healthz?timeout=32s: (1.0011662s) 500
>goroutine 26115 [running]:
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).recordStatus(0xc427b98930, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:207 +0xdd
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).WriteHeader(0xc427b98930, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:186 +0x35
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*baseTimeoutWriter).WriteHeader(0xc4202acc40, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:188 +0xac
>net/http.Error(0x7f3dea8f5da8, 0xc433c31270, 0xc436cba480, 0x46c, 0x1f4)
>	/usr/lib/golang/src/net/http/server.go:1930 +0xda
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz.handleRootHealthz.func1(0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz/healthz.go:130 +0x508
>net/http.HandlerFunc.ServeHTTP(0xc4355a08c0, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc42e320a80, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:241 +0x55a
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc42828d2d0, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0xa1
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x5a4d0f6, 0xf, 0xc42cfcf7a0, 0xc42828d2d0, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/handler.go:160 +0x6ad
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.(*director).ServeHTTP(0xc42c6c4be0, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	<autogenerated>:1 +0x75
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:52 +0x37d
>net/http.HandlerFunc.ServeHTTP(0xc428774f00, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:165 +0x42a
>net/http.HandlerFunc.ServeHTTP(0xc42a8aa200, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:49 +0x203a
>net/http.HandlerFunc.ServeHTTP(0xc428774fa0, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:78 +0x2b1
>net/http.HandlerFunc.ServeHTTP(0xc428775040, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request.WithRequestContext.func1(0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request/requestcontext.go:110 +0xcb
>net/http.HandlerFunc.ServeHTTP(0xc42c6c4cc0, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithCORS.func1(0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/cors.go:75 +0x17b
>net/http.HandlerFunc.ServeHTTP(0xc42c11dc80, 0x7f3dea8f5da8, 0xc433c31270, 0xc43a1c6c00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc42c6c5120, 0xaca4fe0, 0xc433c31270, 0xc43a1c6c00, 0xc42a5e2de0)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:93 +0x8d
>created by github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x1ab
>
>logging error output: "[+]ping ok\n[-]etcd failed: reason withheld\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/project.openshift.io-projectcache ok\n[+]poststarthook/project.openshift.io-projectauthorizationcache ok\n[+]poststarthook/security.openshift.io-bootstrapscc ok\n[+]poststarthook/bootstrap-controller ok\n[+]poststarthook/ca-registration ok\n[+]poststarthook/start-kube-aggregator-informers ok\n[+]poststarthook/apiservice-registration-controller ok\n[+]poststarthook/apiservice-status-available-controller ok\n[+]poststarthook/apiservice-openapi-controller ok\n[+]poststarthook/kube-apiserver-autoregistration ok\n[+]autoregister-completion ok\n[+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok\n[+]poststarthook/authorization.openshift.io-ensureopenshift-infra ok\n[+]poststarthook/quota.openshift.io-clusterquotamapping ok\n[+]poststarthook/openshift.io-AdmissionInit ok\n[+]poststarthook/openshift.io-StartInformers ok\n[+]poststarthook/oauth.openshift.io-StartOAuthClientsBootstrapping ok\nhealthz check failed\n"
> [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/shared-informers] 172.16.120.27:55424]
>I0601 05:17:22.108229       1 handler.go:159] kube-aggregator: GET "/api/v1/nodes/qe-yinzhou-node-registry-router-1" satisfied by nonGoRestful
>I0601 05:17:22.108252       1 pathrecorder.go:247] kube-aggregator: "/api/v1/nodes/qe-yinzhou-node-registry-router-1" satisfied by prefix /api/
>I0601 05:17:22.108261       1 handler.go:149] kube-apiserver: GET "/api/v1/nodes/qe-yinzhou-node-registry-router-1" satisfied by gorestful with webservice /api/v1
>I0601 05:17:22.108634       1 wrap.go:42] GET /api/v1/nodes/qe-yinzhou-node-registry-router-1?resourceVersion=0&timeout=10s: (613.076Âµs) 200 [[hyperkube/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.12:59720]
>I0601 05:17:22.400186       1 handler.go:159] kube-aggregator: GET "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by nonGoRestful
>I0601 05:17:22.400226       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by prefix /api/
>I0601 05:17:22.400236       1 handler.go:149] kube-apiserver: GET "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by gorestful with webservice /api/v1
>I0601 05:17:22.401388       1 wrap.go:42] GET /api/v1/namespaces/kube-system/configmaps/kube-controller-manager: (1.409099ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:22.402156       1 handler.go:159] kube-aggregator: GET "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by nonGoRestful
>I0601 05:17:22.402216       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by prefix /api/
>I0601 05:17:22.402230       1 handler.go:149] kube-apiserver: GET "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by gorestful with webservice /api/v1
>I0601 05:17:22.403989       1 wrap.go:42] GET /api/v1/namespaces/kube-system/configmaps/openshift-master-controllers: (2.549518ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:55424]
>I0601 05:17:22.404415       1 handler.go:159] kube-aggregator: PUT "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by nonGoRestful
>I0601 05:17:22.404430       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by prefix /api/
>I0601 05:17:22.404438       1 handler.go:149] kube-apiserver: PUT "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by gorestful with webservice /api/v1
>I0601 05:17:22.405170       1 handler.go:159] kube-aggregator: PUT "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by nonGoRestful
>I0601 05:17:22.405218       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by prefix /api/
>I0601 05:17:22.405226       1 handler.go:149] kube-apiserver: PUT "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by gorestful with webservice /api/v1
>I0601 05:17:22.408751       1 wrap.go:42] PUT /api/v1/namespaces/kube-system/configmaps/openshift-master-controllers: (3.763094ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:55424]
>I0601 05:17:22.409085       1 wrap.go:42] PUT /api/v1/namespaces/kube-system/configmaps/kube-controller-manager: (4.830218ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:22.414292       1 handler.go:159] kube-aggregator: PATCH "/api/v1/nodes/qe-yinzhou-node-registry-router-1/status" satisfied by nonGoRestful
>I0601 05:17:22.414312       1 pathrecorder.go:247] kube-aggregator: "/api/v1/nodes/qe-yinzhou-node-registry-router-1/status" satisfied by prefix /api/
>I0601 05:17:22.414320       1 handler.go:149] kube-apiserver: PATCH "/api/v1/nodes/qe-yinzhou-node-registry-router-1/status" satisfied by gorestful with webservice /api/v1
>I0601 05:17:22.417201       1 wrap.go:42] PATCH /api/v1/nodes/qe-yinzhou-node-registry-router-1/status?timeout=10s: (3.116336ms) 200 [[hyperkube/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.12:59720]
>I0601 05:17:22.486042       1 handler.go:159] kube-aggregator: GET "/api/v1/nodes/qe-yinzhou-master-etcd-1" satisfied by nonGoRestful
>I0601 05:17:22.486070       1 pathrecorder.go:247] kube-aggregator: "/api/v1/nodes/qe-yinzhou-master-etcd-1" satisfied by prefix /api/
>I0601 05:17:22.486080       1 handler.go:149] kube-apiserver: GET "/api/v1/nodes/qe-yinzhou-master-etcd-1" satisfied by gorestful with webservice /api/v1
>I0601 05:17:22.486360       1 wrap.go:42] GET /api/v1/nodes/qe-yinzhou-master-etcd-1?resourceVersion=0&timeout=10s: (557.973Âµs) 200 [[hyperkube/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:58916]
>I0601 05:17:22.901522       1 handler.go:159] kube-aggregator: GET "/healthz" satisfied by nonGoRestful
>I0601 05:17:22.901540       1 pathrecorder.go:240] kube-aggregator: "/healthz" satisfied by exact match
>I0601 05:17:22.941879       1 handler.go:159] kube-aggregator: GET "/healthz" satisfied by nonGoRestful
>I0601 05:17:22.941896       1 pathrecorder.go:240] kube-aggregator: "/healthz" satisfied by exact match
>I0601 05:17:23.112747       1 handler.go:159] kube-aggregator: PATCH "/api/v1/nodes/qe-yinzhou-master-etcd-1/status" satisfied by nonGoRestful
>I0601 05:17:23.112783       1 pathrecorder.go:247] kube-aggregator: "/api/v1/nodes/qe-yinzhou-master-etcd-1/status" satisfied by prefix /api/
>I0601 05:17:23.112792       1 handler.go:149] kube-apiserver: PATCH "/api/v1/nodes/qe-yinzhou-master-etcd-1/status" satisfied by gorestful with webservice /api/v1
>I0601 05:17:23.121192       1 wrap.go:42] PATCH /api/v1/nodes/qe-yinzhou-master-etcd-1/status?timeout=10s: (8.676955ms) 200 [[hyperkube/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:58916]
>I0601 05:17:23.408009       1 controller.go:105] OpenAPI AggregationController: Processing item v1beta1.servicecatalog.k8s.io
>E0601 05:17:23.408109       1 controller.go:111] loading OpenAPI spec for "v1beta1.servicecatalog.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
>, Header: map[X-Content-Type-Options:[nosniff] Content-Type:[text/plain; charset=utf-8]]
>I0601 05:17:23.408121       1 controller.go:119] OpenAPI AggregationController: action for item v1beta1.servicecatalog.k8s.io: Rate Limited Requeue.
>I0601 05:17:23.450551       1 handler.go:159] kube-aggregator: GET "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by nonGoRestful
>I0601 05:17:23.450577       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by prefix /api/
>I0601 05:17:23.450586       1 handler.go:149] kube-apiserver: GET "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by gorestful with webservice /api/v1
>I0601 05:17:23.451655       1 wrap.go:42] GET /api/v1/namespaces/kube-system/configmaps/kube-scheduler: (1.37098ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:23.452368       1 handler.go:159] kube-aggregator: PUT "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by nonGoRestful
>I0601 05:17:23.452392       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by prefix /api/
>I0601 05:17:23.452402       1 handler.go:149] kube-apiserver: PUT "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by gorestful with webservice /api/v1
>I0601 05:17:23.454043       1 wrap.go:42] PUT /api/v1/namespaces/kube-system/configmaps/kube-scheduler: (1.836808ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:23.901854       1 wrap.go:42] GET /healthz?timeout=32s: (1.000543708s) 500
>goroutine 26410 [running]:
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).recordStatus(0xc427ba7d50, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:207 +0xdd
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).WriteHeader(0xc427ba7d50, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:186 +0x35
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*baseTimeoutWriter).WriteHeader(0xc4218aad20, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:188 +0xac
>net/http.Error(0x7f3dea8f5da8, 0xc430af9cc8, 0xc436cbbb00, 0x46c, 0x1f4)
>	/usr/lib/golang/src/net/http/server.go:1930 +0xda
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz.handleRootHealthz.func1(0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz/healthz.go:130 +0x508
>net/http.HandlerFunc.ServeHTTP(0xc4355a08c0, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc42e320a80, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:241 +0x55a
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc42828d2d0, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0xa1
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x5a4d0f6, 0xf, 0xc42cfcf7a0, 0xc42828d2d0, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/handler.go:160 +0x6ad
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.(*director).ServeHTTP(0xc42c6c4be0, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	<autogenerated>:1 +0x75
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:52 +0x37d
>net/http.HandlerFunc.ServeHTTP(0xc428774f00, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:165 +0x42a
>net/http.HandlerFunc.ServeHTTP(0xc42a8aa200, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:49 +0x203a
>net/http.HandlerFunc.ServeHTTP(0xc428774fa0, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:78 +0x2b1
>net/http.HandlerFunc.ServeHTTP(0xc428775040, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request.WithRequestContext.func1(0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request/requestcontext.go:110 +0xcb
>net/http.HandlerFunc.ServeHTTP(0xc42c6c4cc0, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithCORS.func1(0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/cors.go:75 +0x17b
>net/http.HandlerFunc.ServeHTTP(0xc42c11dc80, 0x7f3dea8f5da8, 0xc430af9cc8, 0xc439ef1900)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc42c6c5120, 0xaca4fe0, 0xc430af9cc8, 0xc439ef1900, 0xc43695c1e0)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:93 +0x8d
>created by github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x1ab
>
>logging error output: "[+]ping ok\n[-]etcd failed: reason withheld\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/project.openshift.io-projectcache ok\n[+]poststarthook/project.openshift.io-projectauthorizationcache ok\n[+]poststarthook/security.openshift.io-bootstrapscc ok\n[+]poststarthook/bootstrap-controller ok\n[+]poststarthook/ca-registration ok\n[+]poststarthook/start-kube-aggregator-informers ok\n[+]poststarthook/apiservice-registration-controller ok\n[+]poststarthook/apiservice-status-available-controller ok\n[+]poststarthook/apiservice-openapi-controller ok\n[+]poststarthook/kube-apiserver-autoregistration ok\n[+]autoregister-completion ok\n[+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok\n[+]poststarthook/authorization.openshift.io-ensureopenshift-infra ok\n[+]poststarthook/quota.openshift.io-clusterquotamapping ok\n[+]poststarthook/openshift.io-AdmissionInit ok\n[+]poststarthook/openshift.io-StartInformers ok\n[+]poststarthook/oauth.openshift.io-StartOAuthClientsBootstrapping ok\nhealthz check failed\n"
> [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:55424]
>I0601 05:17:23.942130       1 wrap.go:42] GET /healthz?timeout=32s: (1.000413385s) 500
>goroutine 26349 [running]:
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).recordStatus(0xc427b771f0, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:207 +0xdd
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).WriteHeader(0xc427b771f0, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:186 +0x35
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*baseTimeoutWriter).WriteHeader(0xc42157dee0, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:188 +0xac
>net/http.Error(0x7f3dea8f5da8, 0xc42a97bc40, 0xc42c8edb00, 0x46c, 0x1f4)
>	/usr/lib/golang/src/net/http/server.go:1930 +0xda
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz.handleRootHealthz.func1(0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz/healthz.go:130 +0x508
>net/http.HandlerFunc.ServeHTTP(0xc4355a08c0, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc42e320a80, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:241 +0x55a
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc42828d2d0, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0xa1
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x5a4d0f6, 0xf, 0xc42cfcf7a0, 0xc42828d2d0, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/handler.go:160 +0x6ad
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.(*director).ServeHTTP(0xc42c6c4be0, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	<autogenerated>:1 +0x75
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:52 +0x37d
>net/http.HandlerFunc.ServeHTTP(0xc428774f00, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:165 +0x42a
>net/http.HandlerFunc.ServeHTTP(0xc42a8aa200, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:49 +0x203a
>net/http.HandlerFunc.ServeHTTP(0xc428774fa0, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:78 +0x2b1
>net/http.HandlerFunc.ServeHTTP(0xc428775040, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request.WithRequestContext.func1(0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request/requestcontext.go:110 +0xcb
>net/http.HandlerFunc.ServeHTTP(0xc42c6c4cc0, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithCORS.func1(0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/cors.go:75 +0x17b
>net/http.HandlerFunc.ServeHTTP(0xc42c11dc80, 0x7f3dea8f5da8, 0xc42a97bc40, 0xc434d22e00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc42c6c5120, 0xaca4fe0, 0xc42a97bc40, 0xc434d22e00, 0xc42b649da0)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:93 +0x8d
>created by github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x1ab
>
>logging error output: "[+]ping ok\n[-]etcd failed: reason withheld\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/project.openshift.io-projectcache ok\n[+]poststarthook/project.openshift.io-projectauthorizationcache ok\n[+]poststarthook/security.openshift.io-bootstrapscc ok\n[+]poststarthook/bootstrap-controller ok\n[+]poststarthook/ca-registration ok\n[+]poststarthook/start-kube-aggregator-informers ok\n[+]poststarthook/apiservice-registration-controller ok\n[+]poststarthook/apiservice-status-available-controller ok\n[+]poststarthook/apiservice-openapi-controller ok\n[+]poststarthook/kube-apiserver-autoregistration ok\n[+]autoregister-completion ok\n[+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok\n[+]poststarthook/authorization.openshift.io-ensureopenshift-infra ok\n[+]poststarthook/quota.openshift.io-clusterquotamapping ok\n[+]poststarthook/openshift.io-AdmissionInit ok\n[+]poststarthook/openshift.io-StartInformers ok\n[+]poststarthook/oauth.openshift.io-StartOAuthClientsBootstrapping ok\nhealthz check failed\n"
> [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/shared-informers] 172.16.120.27:55424]
>I0601 05:17:24.901415       1 handler.go:159] kube-aggregator: GET "/healthz" satisfied by nonGoRestful
>I0601 05:17:24.901443       1 pathrecorder.go:240] kube-aggregator: "/healthz" satisfied by exact match
>I0601 05:17:24.941921       1 handler.go:159] kube-aggregator: GET "/healthz" satisfied by nonGoRestful
>I0601 05:17:24.941958       1 pathrecorder.go:240] kube-aggregator: "/healthz" satisfied by exact match
>I0601 05:17:25.410027       1 handler.go:159] kube-aggregator: GET "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by nonGoRestful
>I0601 05:17:25.410054       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by prefix /api/
>I0601 05:17:25.410063       1 handler.go:149] kube-apiserver: GET "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by gorestful with webservice /api/v1
>I0601 05:17:25.410537       1 handler.go:159] kube-aggregator: GET "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by nonGoRestful
>I0601 05:17:25.410560       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by prefix /api/
>I0601 05:17:25.410576       1 handler.go:149] kube-apiserver: GET "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by gorestful with webservice /api/v1
>I0601 05:17:25.411936       1 wrap.go:42] GET /api/v1/namespaces/kube-system/configmaps/openshift-master-controllers: (1.587334ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:55424]
>I0601 05:17:25.412135       1 wrap.go:42] GET /api/v1/namespaces/kube-system/configmaps/kube-controller-manager: (2.329304ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:25.413122       1 handler.go:159] kube-aggregator: PUT "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by nonGoRestful
>I0601 05:17:25.413140       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by prefix /api/
>I0601 05:17:25.413140       1 handler.go:159] kube-aggregator: PUT "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by nonGoRestful
>I0601 05:17:25.413149       1 handler.go:149] kube-apiserver: PUT "/api/v1/namespaces/kube-system/configmaps/kube-controller-manager" satisfied by gorestful with webservice /api/v1
>I0601 05:17:25.413154       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by prefix /api/
>I0601 05:17:25.413165       1 handler.go:149] kube-apiserver: PUT "/api/v1/namespaces/kube-system/configmaps/openshift-master-controllers" satisfied by gorestful with webservice /api/v1
>I0601 05:17:25.415440       1 wrap.go:42] PUT /api/v1/namespaces/kube-system/configmaps/kube-controller-manager: (2.513267ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:25.415771       1 wrap.go:42] PUT /api/v1/namespaces/kube-system/configmaps/openshift-master-controllers: (2.775052ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:55424]
>I0601 05:17:25.454856       1 handler.go:159] kube-aggregator: GET "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by nonGoRestful
>I0601 05:17:25.454888       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by prefix /api/
>I0601 05:17:25.454896       1 handler.go:149] kube-apiserver: GET "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by gorestful with webservice /api/v1
>I0601 05:17:25.455755       1 wrap.go:42] GET /api/v1/namespaces/kube-system/configmaps/kube-scheduler: (1.065331ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:25.456458       1 handler.go:159] kube-aggregator: PUT "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by nonGoRestful
>I0601 05:17:25.456481       1 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by prefix /api/
>I0601 05:17:25.456491       1 handler.go:149] kube-apiserver: PUT "/api/v1/namespaces/kube-system/configmaps/kube-scheduler" satisfied by gorestful with webservice /api/v1
>I0601 05:17:25.458070       1 wrap.go:42] PUT /api/v1/namespaces/kube-system/configmaps/kube-scheduler: (1.77104ms) 200 [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/leader-election] 172.16.120.27:55424]
>I0601 05:17:25.901742       1 wrap.go:42] GET /healthz?timeout=32s: (1.000573333s) 500
>goroutine 26590 [running]:
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).recordStatus(0xc427606000, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:207 +0xdd
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).WriteHeader(0xc427606000, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:186 +0x35
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*baseTimeoutWriter).WriteHeader(0xc4212d0bc0, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:188 +0xac
>net/http.Error(0x7f3dea8f5da8, 0xc42a97bd10, 0xc439ab8900, 0x46c, 0x1f4)
>	/usr/lib/golang/src/net/http/server.go:1930 +0xda
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz.handleRootHealthz.func1(0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz/healthz.go:130 +0x508
>net/http.HandlerFunc.ServeHTTP(0xc4355a08c0, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc42e320a80, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:241 +0x55a
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc42828d2d0, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0xa1
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x5a4d0f6, 0xf, 0xc42cfcf7a0, 0xc42828d2d0, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/handler.go:160 +0x6ad
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.(*director).ServeHTTP(0xc42c6c4be0, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	<autogenerated>:1 +0x75
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:52 +0x37d
>net/http.HandlerFunc.ServeHTTP(0xc428774f00, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:165 +0x42a
>net/http.HandlerFunc.ServeHTTP(0xc42a8aa200, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:49 +0x203a
>net/http.HandlerFunc.ServeHTTP(0xc428774fa0, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:78 +0x2b1
>net/http.HandlerFunc.ServeHTTP(0xc428775040, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request.WithRequestContext.func1(0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request/requestcontext.go:110 +0xcb
>net/http.HandlerFunc.ServeHTTP(0xc42c6c4cc0, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithCORS.func1(0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/cors.go:75 +0x17b
>net/http.HandlerFunc.ServeHTTP(0xc42c11dc80, 0x7f3dea8f5da8, 0xc42a97bd10, 0xc439b0af00)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc42c6c5120, 0xaca4fe0, 0xc42a97bd10, 0xc439b0af00, 0xc433c80c00)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:93 +0x8d
>created by github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x1ab
>
>logging error output: "[+]ping ok\n[-]etcd failed: reason withheld\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/project.openshift.io-projectcache ok\n[+]poststarthook/project.openshift.io-projectauthorizationcache ok\n[+]poststarthook/security.openshift.io-bootstrapscc ok\n[+]poststarthook/bootstrap-controller ok\n[+]poststarthook/ca-registration ok\n[+]poststarthook/start-kube-aggregator-informers ok\n[+]poststarthook/apiservice-registration-controller ok\n[+]poststarthook/apiservice-status-available-controller ok\n[+]poststarthook/apiservice-openapi-controller ok\n[+]poststarthook/kube-apiserver-autoregistration ok\n[+]autoregister-completion ok\n[+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok\n[+]poststarthook/authorization.openshift.io-ensureopenshift-infra ok\n[+]poststarthook/quota.openshift.io-clusterquotamapping ok\n[+]poststarthook/openshift.io-AdmissionInit ok\n[+]poststarthook/openshift.io-StartInformers ok\n[+]poststarthook/oauth.openshift.io-StartOAuthClientsBootstrapping ok\nhealthz check failed\n"
> [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8] 172.16.120.27:55424]
>I0601 05:17:25.942205       1 wrap.go:42] GET /healthz?timeout=32s: (1.000458883s) 500
>goroutine 26592 [running]:
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).recordStatus(0xc427606150, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:207 +0xdd
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).WriteHeader(0xc427606150, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:186 +0x35
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*baseTimeoutWriter).WriteHeader(0xc4212d0da0, 0x1f4)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:188 +0xac
>net/http.Error(0x7f3dea8f5da8, 0xc42a97bd20, 0xc439ab9b00, 0x46c, 0x1f4)
>	/usr/lib/golang/src/net/http/server.go:1930 +0xda
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz.handleRootHealthz.func1(0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/healthz/healthz.go:130 +0x508
>net/http.HandlerFunc.ServeHTTP(0xc4355a08c0, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc42e320a80, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:241 +0x55a
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc42828d2d0, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0xa1
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x5a4d0f6, 0xf, 0xc42cfcf7a0, 0xc42828d2d0, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/handler.go:160 +0x6ad
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server.(*director).ServeHTTP(0xc42c6c4be0, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	<autogenerated>:1 +0x75
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:52 +0x37d
>net/http.HandlerFunc.ServeHTTP(0xc428774f00, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:165 +0x42a
>net/http.HandlerFunc.ServeHTTP(0xc42a8aa200, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:49 +0x203a
>net/http.HandlerFunc.ServeHTTP(0xc428774fa0, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:78 +0x2b1
>net/http.HandlerFunc.ServeHTTP(0xc428775040, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request.WithRequestContext.func1(0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/endpoints/request/requestcontext.go:110 +0xcb
>net/http.HandlerFunc.ServeHTTP(0xc42c6c4cc0, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.WithCORS.func1(0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/cors.go:75 +0x17b
>net/http.HandlerFunc.ServeHTTP(0xc42c11dc80, 0x7f3dea8f5da8, 0xc42a97bd20, 0xc439b0b700)
>	/usr/lib/golang/src/net/http/server.go:1918 +0x44
>github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc42c6c5120, 0xaca4fe0, 0xc42a97bd20, 0xc439b0b700, 0xc433c80d20)
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:93 +0x8d
>created by github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP
>	/builddir/build/BUILD/atomic-openshift-git-0.c304575/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x1ab
>
>logging error output: "[+]ping ok\n[-]etcd failed: reason withheld\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/project.openshift.io-projectcache ok\n[+]poststarthook/project.openshift.io-projectauthorizationcache ok\n[+]poststarthook/security.openshift.io-bootstrapscc ok\n[+]poststarthook/bootstrap-controller ok\n[+]poststarthook/ca-registration ok\n[+]poststarthook/start-kube-aggregator-informers ok\n[+]poststarthook/apiservice-registration-controller ok\n[+]poststarthook/apiservice-status-available-controller ok\n[+]poststarthook/apiservice-openapi-controller ok\n[+]poststarthook/kube-apiserver-autoregistration ok\n[+]autoregister-completion ok\n[+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok\n[+]poststarthook/authorization.openshift.io-ensureopenshift-infra ok\n[+]poststarthook/quota.openshift.io-clusterquotamapping ok\n[+]poststarthook/openshift.io-AdmissionInit ok\n[+]poststarthook/openshift.io-StartInformers ok\n[+]poststarthook/oauth.openshift.io-StartOAuthClientsBootstrapping ok\nhealthz check failed\n"
> [[openshift/v1.10.0+b81c8f8 (linux/amd64) kubernetes/b81c8f8/shared-informers] 172.16.120.27:55424]
>I0601 05:17:26.901780       1 handler.go:159] kube-aggregator: GET "/healthz" satisfied by nonGoRestful
>I0601 05:17:26.901812       1 pathrecorder.go:240] kube-aggregator: "/healthz" satisfied by exact match
>I0601 05:17:26.941875       1 handler.go:159] kube-aggregator: GET "/healthz" satisfied by nonGoRestful
>I0601 05:17:26.941897       1 pathrecorder.go:240] kube-aggregator: "/healthz" satisfied by exact match
>error: unexpected EOF
>

Actions: View

Attachments on bug 1584995: 1446537 | 1446608 | 1447322 | 1447323 | 1447324