Bug 1918068

Summary: Flaky olm integration tests
Product: OpenShift Container Platform Reporter: Jon Jackson <jonjacks>
Component: Management ConsoleAssignee: Jon Jackson <jonjacks>
Status: CLOSED ERRATA QA Contact: Yadan Pei <yapei>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 4.7CC: aos-bugs, jokerman, spadgett, yapei
Target Milestone: ---   
Target Release: 4.7.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Cause: CatalogSource detail view integration tests was looking for the filter toolbar on the CatalogSource details page Operators tab right after the CatalogSource was created. It takes a few seconds for the PackageManifests that drive that page to be created on the cluster, and PackageManifests don't support k8s watches. Consequence: If no PackageManifest has been created yet when you initially visit the CatlogSource detail Operators tab, the filter toolbar will not be present and it will never appear without reloading the page. This causes the test to time out and fail sometimes. Fix: Make our k8s watch helper fall back to polling every 15 seconds if watching is not supported. This allows the PackageManifest page to update as the resources are created on the cluster without a page reload. Update the integration test to remove conditional logic and retries that were there because the page was static. Result: This test case passes reliably.
 Story Points: ---
Clone Of: Environment:
Last Closed: 2021-02-24 15:54:42 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jon Jackson 2021-01-20 00:10:57 UTC 
Description of problem:
OLM integration tests related to operator installation workflow are flaking frequently.


Version-Release number of selected component (if applicable):
4.7

How reproducible:
Frequently

Steps to Reproduce:
1. Run `yarn test-cypress-olm` in frontend working dir

Actual results:
OLM operator install integration test suites fail frequently

Expected results:
OLM operator install integration test suites always pass
Comment 3 Yadan Pei 2021-01-26 09:04:33 UTC 
Search co-clusterserviceversion-logo__name__clusterserviceversion in CI logs within 7 days, we can see only one failure which is mentioned in the PR comment, no more related failures

https://search.ci.openshift.org/?search=co-clusterserviceversion-logo__name__clusterserviceversion&maxAge=168h&context=1&type=bug%2Bjunit&name=&maxMatches=5&maxBytes=20971520&groupBy=job 

Moving to VERIFIED
Comment 6 errata-xmlrpc 2021-02-24 15:54:42 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.7.0 security, bug fix, and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2020:5633