Bug 851740

Summary: rhc tests are failing very often (even on retries), take too long, and cannot do individual retries
Product: OKD Reporter: Dan McPherson <dmcphers>
Component: ocAssignee: Fotios Lindiakos <fotios>
Status: CLOSED UPSTREAM QA Contact: libra bugs <libra-bugs>
Severity: medium Docs Contact:
Priority: medium    
Version: 2.xCC: jinzhang, jkeck
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-10-02 17:25:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
rhc extended log none

Description Dan McPherson 2012-08-25 02:29:30 UTC 
Here is an example:

https://ci.dev.openshift.redhat.com/jenkins/job/merge_pull_request/295/console


- They are taking about 6.5 mins when they pass (the target is 5)
- When they do fail the entire test suite shouldn't need to be rerun or it needs to be split up into multiple suites that run on separate threads.
- They seem to be failing a lot.  In the example above it took 3 runs to pass.
Comment 1 John Poelstra 2012-09-07 18:38:53 UTC 
fotios is looking at today
Comment 2 John Poelstra 2012-09-11 17:04:29 UTC 
expecting fix today
Comment 3 Fotios Lindiakos 2012-09-14 19:42:31 UTC 
Tests are being run against this pull-request: https://github.com/openshift/li/pull/374
Comment 4 joycezhang 2012-09-19 10:41:29 UTC 
Move to ON_QA as pull request is merged.
Comment 5 joycezhang 2012-09-19 10:53:34 UTC 
Created attachment 614304 [details]
rhc extended log

By checking rhc extended log, there's still one group take more than 6m as below. Others are lower than 5m.

          -----------------------------------------------------------
                      Begin Output From RHC Functional: application Tests
          -----------------------------------------------------------

8 scenarios (8 passed)
23 steps (23 passed)
6m6.965s

          -----------------------------------------------------------
                       End Output From RHC Functional: application Tests
          -----------------------------------------------------------

Please get all log from attachement.

Need to double confirm if the result is acceptable. Thanks.
Comment 6 joycezhang 2012-09-20 02:34:40 UTC 
Could you please help double confirm if the item above is acceptable or not? Thanks.