Bug 1319402

Summary: Docker Error/Spam on startup
Product: Red Hat Enterprise Linux 7 Reporter: Eric Paris <eparis>
Component: dockerAssignee: smahajan <smahajan>
Status: CLOSED CURRENTRELEASE QA Contact: atomic-bugs <atomic-bugs>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 7.3CC: dwalsh, lsm5
Target Milestone: rcKeywords: Extras
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-06-03 13:28:33 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Eric Paris 2016-03-19 14:41:01 UTC 
docker-1.9.1-23.el7.x86_64
running under kubernetes + flannel.

I was running 1.9.1-9.el7 and also saw these messages there as well.

It seems to be working, so these seem to be just log spam...


Mar 19 14:33:17 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:33:17.556173672Z" level=error msg="HTTP Error" err="no such id: 7dc10e45b499cd37cb74304f741a33721d1a2845839d9669f5285528a17bea39" statusCode=404
Mar 19 14:33:17 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:33:17.556103493Z" level=error msg="Handler for GET /containers/7dc10e45b499cd37cb74304f741a33721d1a2845839d9669f5285528a17bea39/json returned error: no such id: 7dc10e45b499cd37cb74304f741a33721d1a2845839d9669f5285528a17bea39"



Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com systemd[1]: Started Docker Application Container Engine.
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.637734512Z" level=error msg="Failed to load container e6a871ab7981eb0aff8dcce459695146d2e5c45cbddfa25b2b8bf22b6f75224f: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.635819691Z" level=error msg="Failed to load container e1ae94c91d7b2f0197a95ee035821c6c4603569f9698ac49bf05b54339897953: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.633109681Z" level=error msg="Failed to load container d5f15aad5ef2264d1dbbef4da88da12af9d14db0626c51318715e2e10ad0db34: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.630472516Z" level=error msg="Failed to load container d1577098e55b1172925944462b870e093221ac66bfa80b1e3067c106f7863025: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.615321725Z" level=error msg="Failed to load container b9f546d29d83ad766dcc39e0709f02038b9e17afab43b7423bd588d4b15bde31: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.588523865Z" level=error msg="Failed to load container 9f6a8f1bc534d02bbc439bdeb71bc84f921a557afdefff177c5517fa99cd9f5c: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.588178558Z" level=error msg="Failed to load container 9ebfd7d64ef75d2bbe7e5538d0828b2821bc816b8a5b391a64851800813bd15e: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.581955793Z" level=error msg="Failed to load container 9236c9778d4fd37b18d8fe5968b2b3519643c8a1940eb85c66538c8bd06dbb11: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.579398732Z" level=error msg="Failed to load container 8c990aa3e98b6b13297e9d20d7c2016320974f306cb05842c68eb49f67f0173a: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.556751446Z" level=error msg="Failed to load container 6f1ab95f9f1ffd3083c9c6a7530c152fcbd08376b834b024e67a8bea25f22047: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.554739463Z" level=error msg="Failed to load container 6e8b84a0cb25032ae9cada5366cc7f7377356b33e9a14572bea8929d1fb13010: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.552157149Z" level=error msg="Failed to load container 66cfe9b693371a55ad71c503ece0a62aa3972313421a0d4d601637a77154d079: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.550449762Z" level=error msg="Failed to load container 5aa57f53cb0b3b0777b04b0d5f689f2a378b3e7c40f5694366e9a9ef73e3867a: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.549289413Z" level=error msg="Failed to load container 59b2160f55b8ac49bfbd1d34316d447d45f48f7022dfdd26c93a1347c17d6252: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.548846744Z" level=error msg="Failed to load container 5778e869d6d3323fefe3a46ab6794a132aa593d6fca9fd1f043d6397d807ed2f: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.546158284Z" level=error msg="Failed to load container 53d45b524d41ca2ab7841f68cb247349e65b2dadf2d3434d349bf606ee5cc863: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.517043986Z" level=error msg="Failed to load container 3cb020c25847b247a20635272017db47cc20e0abae9efe4fbd95a1a539031356: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.514507594Z" level=error msg="Failed to load container 393046474d0733526ccc1ed22116b05ebec7761f6015db0195f15fd56ee14c6a: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:43 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: time="2016-03-19T14:32:43.505373543Z" level=error msg="Failed to load container 205fb8f558f6c5406ad8683b67430541a2c2d18122e45c72d34f9fd0aca01804: json: cannot unmarshal array into Go value of type map[string]*network.EndpointSettings"
Mar 19 14:32:42 eparis-submit-queue-registry.osop.rhcloud.com forward-journal[5575]: Forwarding stdin to journald using Priority Informational and tag docker
Mar 19 14:32:42 eparis-submit-queue-registry.osop.rhcloud.com systemd[1]: Starting Docker Application Container Engine...
Mar 19 14:32:29 eparis-submit-queue-registry.osop.rhcloud.com systemd[1]: Stopping Docker Application Container Engine...
Mar 19 14:32:18 eparis-submit-queue-registry.osop.rhcloud.com systemd[1]: Started Docker Application Container Engine.
Comment 2 smahajan@redhat.com 2016-03-22 18:00:48 UTC 
Can you share the output of `docker info` and `docker version` ?

Shishir
Comment 3 Eric Paris 2016-03-22 18:26:47 UTC 
[root@eparis-submit-queue-registry centos]# docker info
Containers: 35
Images: 251
Server Version: 1.9.1
Storage Driver: devicemapper
 Pool Name: dockerVG-docker--pool
 Pool Blocksize: 524.3 kB
 Base Device Size: 107.4 GB
 Backing Filesystem: xfs
 Data file: 
 Metadata file: 
 Data Space Used: 7.52 GB
 Data Space Total: 17.79 GB
 Data Space Available: 10.27 GB
 Metadata Space Used: 4.039 MB
 Metadata Space Total: 25.17 MB
 Metadata Space Available: 21.13 MB
 Udev Sync Supported: true
 Deferred Removal Enabled: false
 Deferred Deletion Enabled: false
 Deferred Deleted Device Count: 0
 Library Version: 1.02.107-RHEL7 (2015-12-01)
Execution Driver: native-0.2
Logging Driver: json-file
Kernel Version: 3.10.0-327.4.5.el7.x86_64
Operating System: CentOS Linux 7 (Core)
CPUs: 2
Total Memory: 3.703 GiB
Name: eparis-submit-queue-registry.osop.rhcloud.com
ID: OZIL:RKLD:YFAJ:4K3E:JL2J:65XH:RDR6:DGD4:4L46:6HVA:NYHE:T76S
WARNING: bridge-nf-call-ip6tables is disabled
[root@eparis-submit-queue-registry centos]# docker version
Client:
 Version:         1.9.1
 API version:     1.21
 Package version: docker-1.9.1-23.el7.x86_64
 Go version:      go1.4.2
 Git commit:      f97fb16/1.9.1
 Built:           
 OS/Arch:         linux/amd64

Server:
 Version:         1.9.1
 API version:     1.21
 Package version: docker-1.9.1-23.el7.x86_64
 Go version:      go1.4.2
 Git commit:      f97fb16/1.9.1
 Built:           
 OS/Arch:         linux/amd64
Comment 4 smahajan@redhat.com 2016-04-01 15:00:51 UTC 
Hi Eric,

Are you still facing this issue, after we did the debugging the other day ?

Shishir
Comment 5 Daniel Walsh 2016-06-03 13:28:33 UTC 
Fixed in docker-1.9