Bug 1850709

Summary: RH-Operator e2e test should not fail fast
Product: OpenShift Container Platform Reporter: Bowen Song <bsong>
Component: OLMAssignee: Evan Cordell <ecordell>
OLM sub component: OLM QA Contact: Jian Zhang <jiazha>
Status: CLOSED ERRATA Docs Contact:
Severity: low    
Priority: low    
Version: 4.6   
Target Milestone: ---   
Target Release: 4.6.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-10-27 16:08:51 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1852443    

Description Bowen Song 2020-06-24 19:11:22 UTC 
Description of problem:

RH-operator metric and install tests should not fail fast. Some operators may fail to install, all the rest of the operators should still be tested.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 1 Bowen Song 2020-06-24 19:26:12 UTC 
waiting for https://github.com/openshift/release/pull/9901 to merge first and then we can backport https://github.com/operator-framework/operator-lifecycle-manager/pull/1592
Comment 4 Bowen Song 2020-07-02 14:27:47 UTC 
no QA needed. This helps pipeline and the result is clearly shown here [1] that the tests are no longer failing fast. 
[1] https://deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gcs/origin-ci-test/logs/periodic-ci-operator-framework-operator-lifecycle-managment-master-rhoperator-metric-e2e-aws-olm-master-daily/1278569127388123136
Comment 7 errata-xmlrpc 2020-10-27 16:08:51 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4196