Bug 1436391

Summary: Some build failures missing detailed status
Product: OpenShift Container Platform Reporter: Vikas Laad <vlaad>
Component: BuildAssignee: Corey Daley <cdaley>
Status: CLOSED ERRATA QA Contact: Vikas Laad <vlaad>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 3.5.1CC: aos-bugs, bparees, jminter, mifiedle, tdawson
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Cause: Code was not setting status reason and status message for certain failures Consequence: Missing status reason and status message for certain failures Fix: Added code that sets status reason and status message Result: Status reason and message are now set
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-08-10 05:20:02 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1442875    
Bug Blocks:    

Description Vikas Laad 2017-03-27 20:18:43 UTC
Description of problem:
Some of the build failures are missing the reason when docker is running out of space.

proj9       cakephp-mysql-example-27   Source    Git@0014dde   Failed                               About a minute ago   

root@ip-172-31-25-76: ~/svt/openshift_performance/ci/scripts # oc logs -n proj40      cakephp-mysql-example-38-build
no such container: "2a0a03f3a808dc0d11391b4bf83d650146abb264f3be617f7dd69134aa5e1229"root@ip-172-31-25-76: ~/svt/openshift_performance/ci/scripts # oc logs -n proj9       cakephp-mysql-example-27-build
Cloning "https://github.com/redhat-performance/cakephp-ex.git" ...
        Commit: 0014ddebb91bc7dff3a1dabfbd7b51da762a6677 (made changes to enable database example)
        Author: ofthecure <robdean.smith>
        Date:   Mon Apr 25 14:33:06 2016 -0400
DEPRECATED: Use .s2i/bin instead of .sti/bin
error: build error: Error response from daemon: {"message":"devmapper: Thin Pool has 5328 free data blocks which is less than minimum required 6083 free data blocks. Create more free space in thin pool or use dm.min_free_space option to change behavior"}


Version-Release number of selected component (if applicable):
openshift v3.5.3
kubernetes v1.5.2+43a9be4
etcd 3.1.0

How reproducible:


Steps to Reproduce:
1. Run concurrent builds and make sure docker runs out of space on worker nodes
2. See the failed builds

Actual results:
Reason for build failure is missing

Expected results:
Should show reason something like FailureToAssembleContainer

Additional info:
will upload master logs.

Comment 2 Ben Parees 2017-03-30 13:23:30 UTC
Not a blocker since we never expected to provide failure reasons for all possible failures, but we'll fix this to return a generic failure reason and direct the user to the logs.

Comment 3 Corey Daley 2017-03-30 16:28:00 UTC
Submitted pull request https://github.com/openshift/origin/pull/13590

Comment 4 Troy Dawson 2017-04-12 12:59:42 UTC
This has been merged into ocp and is in OCP v3.6.28 or newer.

Comment 6 Vikas Laad 2017-04-28 14:00:16 UTC
Verification of this bug is blocked by https://bugzilla.redhat.com/show_bug.cgi?id=1442875

Comment 7 Jim Minter 2017-05-08 10:18:28 UTC
apologies for the noise, updated wrong bug :(

Comment 8 Vikas Laad 2017-05-11 18:14:34 UTC
Verified in the following version, I see following line for the same kind of build failure

proj3       cakephp-mysql-example-129   Source    Git@0014dde   Failed (ContainerCommitFailed)       4 minutes ago        10s


root@ip-172-31-4-211: ~ # openshift version
openshift v3.6.74
kubernetes v1.6.1+5115d708d7
etcd 3.1.0

Comment 10 errata-xmlrpc 2017-08-10 05:20:02 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:1716