Bug 2052446 - Many Conformance tests are failing in OCP 4.10 with Kuryr
Summary: Many Conformance tests are failing in OCP 4.10 with Kuryr
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Networking
Version: 4.10
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: 4.10.0
Assignee: Michał Dulko
QA Contact: Itay Matza
URL:
Whiteboard:
Depends On: 2048793
Blocks: 2069562
TreeView+ depends on / blocked
 
Reported: 2022-02-09 09:57 UTC by OpenShift BugZilla Robot
Modified: 2022-03-29 07:43 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-03-28 12:03:17 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift cluster-network-operator pull 1303 0 None open [release-4.10] Bug 2052446: Kuryr: Decrease vif_annotation_timeout 2022-02-10 14:04:54 UTC
Red Hat Product Errata RHBA-2022:1026 0 None None None 2022-03-28 12:03:34 UTC

Comment 5 Itay Matza 2022-03-20 23:42:43 UTC 
Verified on OCP 4.10.5 on top of OSP RHOS-16.1-RHEL-8-20211126.n.1 with Kuryr.


Verification steps:
1. Clone the openshift/origin repo and install dependencies 

2. Build the conformance tests: 
> make WHAT=cmd/openshift-tests

3. Prepare the conformance tests input file by discarding unsupported tests:
> ./openshift-tests run --provider '{"type":"openstack"}' --dry-run kubernetes/conformance |\ngrep -v -e NodePort -e nodePort -e 'session affinity' -e 'NetworkPolicy' -e 'Networking Granular Checks' > conformance-test-results/conformance_tests.txt

4. Run kubernetes/conformance:
> ./openshift-tests run kubernetes/conformance --provider '{"type":"openstack"}' -f conformance-test-results/conformance_tests.txt --output-file conformance-test-results/conformance-test.log --junit-dir=conformance-test-results


Results:
The conformance test finished with three failed tests out of 332 test cases.

Failed tests:
- no-testclass._sig-apps__StatefulSet_Basic_StatefulSet_functionality__StatefulSetBasic__Should_recreate_evicted_statefulset__Conformance___Suite_openshift/conformance/parallel/minimal___Suite_k8s_
- no-testclass._sig-cli__Kubectl_client_Guestbook_application_should_create_and_stop_a_working_application___Conformance___Slow___Suite_k8s_
- no-testclass._sig-network__Services_should_serve_multiport_endpoints_from_pods___Conformance___Suite_openshift/conformance/parallel/minimal___Suite_k8s_

Note: Two failed tests are known and failing constantly. Look like failures with Service connectivity.
      The 'apps__StatefulSet_Basic_StatefulSet_functionality__StatefulSetBasic__Should_recreate_evicted_statefulset__Conformance___Suite_openshift' test passed on a rerun.
Comment 9 errata-xmlrpc 2022-03-28 12:03:17 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.10.6 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:1026
Note You need to log in before you can comment on or make changes to this bug.