Bug 1566559
Summary: | [3.9] logspam : CONTAINER_EXITED errors in node logs | ||
---|---|---|---|
Product: | OpenShift Container Platform | Reporter: | Seth Jennings <sjenning> |
Component: | Node | Assignee: | Seth Jennings <sjenning> |
Status: | CLOSED ERRATA | QA Contact: | Weinan Liu <weinliu> |
Severity: | medium | Docs Contact: | |
Priority: | unspecified | ||
Version: | 3.9.0 | CC: | aos-bugs, dma, jokerman, mmccomas, smunilla, vlaad |
Target Milestone: | --- | ||
Target Release: | 3.9.z | ||
Hardware: | Unspecified | ||
OS: | Unspecified | ||
Whiteboard: | |||
Fixed In Version: | Doc Type: | No Doc Update | |
Doc Text: |
undefined
|
Story Points: | --- |
Clone Of: | 1566197 | Environment: | |
Last Closed: | 2018-05-17 06:43:35 UTC | Type: | Bug |
Regression: | --- | Mount Type: | --- |
Documentation: | --- | CRM: | |
Verified Versions: | Category: | --- | |
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
Cloudforms Team: | --- | Target Upstream Version: | |
Embargoed: | |||
Bug Depends On: | 1566197 | ||
Bug Blocks: |
Description
Seth Jennings
2018-04-12 14:02:43 UTC
OSE 3.9 PR: https://github.com/openshift/ose/pull/1211 Issue fixed. # oc version oc v3.9.27 kubernetes v1.9.1+a0ce1bc657 features: Basic-Auth GSSAPI Kerberos SPNEGO Server https://ip-172-18-13-135.ec2.internal:8443 openshift v3.9.27 kubernetes v1.9.1+a0ce1bc657 # uname -a Linux ip-172-18-13-135.ec2.internal 3.10.0-862.el7.x86_64 #1 SMP Wed Mar 21 18:14:51 EDT 2018 x86_64 x86_64 x86_64 GNU/Linux Node logs: [root@ip-172-18-13-135 ~]# systemctl status atomic-openshift-node -l ● atomic-openshift-node.service - OpenShift Node Loaded: loaded (/etc/systemd/system/atomic-openshift-node.service; enabled; vendor preset: disabled) Drop-In: /usr/lib/systemd/system/atomic-openshift-node.service.d └─openshift-sdn-ovs.conf Active: active (running) since Wed 2018-05-02 21:59:51 EDT; 3h 49min ago Docs: https://github.com/openshift/origin Main PID: 14328 (openshift) Memory: 78.3M CGroup: /system.slice/atomic-openshift-node.service └─14328 /usr/bin/openshift start node --config=/etc/origin/node/node-config.yaml --loglevel=5 May 03 01:49:35 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:35.651492 14328 helpers.go:827] eviction manager: observations: signal=memory.available, available: 1279452Ki, capacity: 3687560Ki, time: 2018-05-03 01:49:20.444124789 -0400 EDT m=+13772.290124065 May 03 01:49:35 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:35.651933 14328 helpers.go:827] eviction manager: observations: signal=nodefs.available, available: 14235740Ki, capacity: 18422Mi, time: 2018-05-03 01:49:20.444124789 -0400 EDT m=+13772.290124065 May 03 01:49:35 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:35.651957 14328 helpers.go:827] eviction manager: observations: signal=nodefs.inodesFree, available: 9399560, capacity: 9Mi, time: 2018-05-03 01:49:20.444124789 -0400 EDT m=+13772.290124065 May 03 01:49:35 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:35.651996 14328 helpers.go:827] eviction manager: observations: signal=imagefs.available, available: 10912256Ki, capacity: 12492Mi, time: 2018-05-03 01:49:20.444124789 -0400 EDT m=+13772.290124065 May 03 01:49:35 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:35.652007 14328 helpers.go:829] eviction manager: observations: signal=allocatableMemory.available, available: 3394848Ki, capacity: 3687560Ki May 03 01:49:35 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:35.652029 14328 eviction_manager.go:325] eviction manager: no resources are starved May 03 01:49:35 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:35.678152 14328 generic.go:183] GenericPLEG: Relisting May 03 01:49:36 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:36.239194 14328 fs.go:406] got devicemapper fs capacity stats: capacity: 13098811392 free: 11174150144 available: 11174150144: May 03 01:49:36 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:36.683846 14328 generic.go:183] GenericPLEG: Relisting May 03 01:49:36 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:36.924850 14328 kubelet.go:1924] SyncLoop (housekeeping) May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.364977 14328 prober.go:165] HTTP-Probe Host: https://10.129.0.2, Port: 8443, Path: /healthz May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.365003 14328 prober.go:168] HTTP-Probe Headers: map[] May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.372418 14328 http.go:96] Probe succeeded for https://10.129.0.2:8443/healthz, Response: {200 OK 200 HTTP/2.0 2 0 map[Date:[Thu, 03 May 2018 05:49:37 GMT] Content-Type:[text/plain; charset=utf-8] Content-Length:[2]] 0xc4230814c0 2 [] false false map[] 0xc4211e4100 0xc42336f810} May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.372455 14328 prober.go:118] Readiness probe for "webconsole-55dd868cdf-cqqsz_openshift-web-console(3a33fc3c-4e76-11e8-8584-0e2b0f5d1944):webconsole" succeeded May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.542795 14328 prober.go:165] HTTP-Probe Host: https://10.129.0.6, Port: 8443, Path: /healthz May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.542822 14328 prober.go:168] HTTP-Probe Headers: map[] May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.564854 14328 http.go:96] Probe succeeded for https://10.129.0.6:8443/healthz, Response: {200 OK 200 HTTP/2.0 2 0 map[Content-Length:[2] Date:[Thu, 03 May 2018 05:49:37 GMT] Content-Type:[text/plain; charset=utf-8]] 0xc4210ea5c0 2 [] false false map[] 0xc4211e4300 0xc42336fa20} May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.564902 14328 prober.go:118] Readiness probe for "apiserver-b729m_openshift-template-service-broker(ed657cbe-4e76-11e8-8584-0e2b0f5d1944):c" succeeded May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.583122 14328 log_handler.go:32] AWS API Send: ec2metadata GetMetadata &{GetMetadata GET /meta-data/network/interfaces/macs <nil> <nil>} <nil> May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.583144 14328 log_handler.go:37] AWS API ValidateResponse: ec2metadata GetMetadata &{GetMetadata GET /meta-data/network/interfaces/macs <nil> <nil>} <nil> 200 OK May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.584480 14328 log_handler.go:32] AWS API Send: ec2metadata GetMetadata &{GetMetadata GET /meta-data/network/interfaces/macs/0e:2b:0f:5d:19:44/local-ipv4s <nil> <nil>} <nil> May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.584499 14328 log_handler.go:37] AWS API ValidateResponse: ec2metadata GetMetadata &{GetMetadata GET /meta-data/network/interfaces/macs/0e:2b:0f:5d:19:44/local-ipv4s <nil> <nil>} <nil> 200 OK May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.585693 14328 log_handler.go:32] AWS API Send: ec2metadata GetMetadata &{GetMetadata GET /meta-data/public-ipv4 <nil> <nil>} <nil> May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.585712 14328 log_handler.go:37] AWS API ValidateResponse: ec2metadata GetMetadata &{GetMetadata GET /meta-data/public-ipv4 <nil> <nil>} <nil> 200 OK May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.586952 14328 log_handler.go:32] AWS API Send: ec2metadata GetMetadata &{GetMetadata GET /meta-data/local-hostname <nil> <nil>} <nil> May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.586971 14328 log_handler.go:37] AWS API ValidateResponse: ec2metadata GetMetadata &{GetMetadata GET /meta-data/local-hostname <nil> <nil>} <nil> 200 OK May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.588774 14328 log_handler.go:32] AWS API Send: ec2metadata GetMetadata &{GetMetadata GET /meta-data/public-hostname <nil> <nil>} <nil> May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.588795 14328 log_handler.go:37] AWS API ValidateResponse: ec2metadata GetMetadata &{GetMetadata GET /meta-data/public-hostname <nil> <nil>} <nil> 200 OK May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.703286 14328 generic.go:183] GenericPLEG: Relisting May 03 01:49:37 ip-172-18-13-135.ec2.internal atomic-openshift-node[14328]: I0503 01:49:37.805302 14328 kubelet.go:2103] Container runtime status: Runtime Conditions: RuntimeReady=true reason: message:, NetworkReady=true reason: message: Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2018:1566 |