Bug 1389648

Summary: Error: build error: Failed to push image: Error storing digest in /var/lib/docker/graph/xxx/checksum: open /var/lib/docker/graph/xxx/checksum: no such file or directory
Product: OpenShift Container Platform Reporter: Jaspreet Kaur <jkaur>
Component: ContainersAssignee: Jhon Honce <jhonce>
Status: CLOSED CURRENTRELEASE QA Contact: DeShuai Ma <dma>
Severity: low Docs Contact:
Priority: high    
Version: 3.2.0CC: amurdaca, aos-bugs, dwalsh, erich, imcleod, jkaur, jokerman, mmccomas, vgoyal
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-09-08 15:32:27 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Jaspreet Kaur 2016-10-28 06:00:57 UTC 
Description of problem: Build failed with error: 

```
...
Pushing [==================================================>] 226.7 MB
Pushing
Pushed
F1020 00:05:31.973702 1 builder.go:204] Error: build error: Failed to push image: Error storing digest in /var/lib/docker/graph/5802cb091d7159a090d662f1fd54eb8ffdccc5216b9b2a31f65dfeeb74a51ac4/checksum: open /var/lib/docker/graph/5802cb091d7159a090d662f1fd54eb8ffdccc5216b9b2a31f65dfeeb74a51ac4/checksum: no such file or directory
```
While the second build is successful.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results: Build fails first time with error while the second build is successful.


Expected results: Build should succeed.


Additional info:
Comment 3 Vivek Goyal 2016-11-10 18:47:22 UTC 
What version of docker you are using. can you paste "docker info" output.
Comment 4 Vivek Goyal 2016-11-10 19:00:53 UTC 
Is there an engineer on openshift side who can tell me where this message is coming from. Is docker outputting this message or some other component.

F1020 00:05:31.973702 1 builder.go:204] Error: build error: Failed to push image: Error storing digest in /var/lib/docker/graph/5802cb091d7159a090d662f1fd54eb8ffdccc5216b9b2a31f65dfeeb74a51ac4/checksum: open /var/lib/docker/graph
Comment 5 Vivek Goyal 2016-11-10 19:03:29 UTC 
I have grepped for string "storing digest" in docker 1.10 and 1.12 code and can't find anything. I am beginning to doubt if docker gave this message.
Comment 7 Antonio Murdaca 2016-11-17 22:02:24 UTC 
Figured out this is a docker-1.9.1 issue (that error is not present in docker 1.10+)
Comment 9 Jhon Honce 2016-11-17 22:23:56 UTC 
$(docker info)

Containers: 194
Images: 1049
Server Version: 1.9.1
Storage Driver: devicemapper
 Pool Name: docker--vg-docker--pool
 Pool Blocksize: 524.3 kB
 Base Device Size: 107.4 GB
 Backing Filesystem: xfs
 Data file:
 Metadata file:
 Data Space Used: 113.1 GB
 Data Space Total: 213.5 GB
 Data Space Available: 100.4 GB
 Metadata Space Used: 36.44 MB
 Metadata Space Total: 218.1 MB
 Metadata Space Available: 181.7 MB
 Udev Sync Supported: true
 Deferred Removal Enabled: true
 Deferred Deletion Enabled: true
 Deferred Deleted Device Count: 0
 Library Version: 1.02.107-RHEL7 (2016-06-09)
Execution Driver: native-0.2
Logging Driver: json-file
Kernel Version: 3.10.0-327.28.3.el7.x86_64
Operating System: OpenShift Enterprise
CPUs: 8
Total Memory: 31.01 GiB
Name: node03.pink.ap-southeast-1.aws.openpaas.axa-cloud.com
ID: G7HL:KUNL:TKHT:K2NU:AQUA:NOV2:J4JJ:ETIY:YGY2:6CZG:TTGT:IHG5
Debug mode (server): true
 File Descriptors: 492
 Goroutines: 726
 System Time: 2016-10-20T10:27:32.176986675+02:00
 EventsListeners: 0
 Init SHA1: bbcd79546e4d7f0203626d68f758aa4841f4c0ad
 Init Path:
 Docker Root Dir: /var/lib/docker
WARNING: bridge-nf-call-iptables is disabled
WARNING: bridge-nf-call-ip6tables is disabled