Bug 1880990 - Multiple CNF tests failing
Summary: Multiple CNF tests failing
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: CNF Platform Validation
Version: 4.6
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 4.6.0
Assignee: Federico Paolinelli
QA Contact: Nikita
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-09-21 11:11 UTC by Sebastian Scheinkman
Modified: 2023-05-16 03:45 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-10-27 16:42:58 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift ptp-operator pull 70 0 None closed Bug 1880990: Fix metric test 2020-10-06 08:17:19 UTC
Github openshift ptp-operator pull 71 0 None closed Bug 1880990: Choose the interfaces between master and slave. 2020-10-06 08:17:19 UTC
Github openshift sriov-network-operator pull 345 0 None closed Bug 1880990: Remove the log verification 2020-10-06 08:17:19 UTC
Github openshift sriov-network-operator pull 346 0 None closed Bug 1880990: Fix macvlan test 2020-10-06 08:17:19 UTC
Github openshift sriov-network-operator pull 351 0 None closed Bug 1880990: Fix the pf down test 2020-10-06 08:17:18 UTC
Github openshift sriov-network-operator pull 353 0 None closed Bug 1880990: Fix the MTU test 2020-10-06 08:17:26 UTC
Github openshift sriov-network-operator pull 356 0 None closed Bug 1880990: SR-IOV conformance flakes. 2020-10-06 08:17:18 UTC
Github openshift sriov-network-operator pull 357 0 None closed Bug 1880990: Fix PF shutdown test. On some nodes route link returns void. 2020-10-06 08:17:16 UTC
Github openshift sriov-network-operator pull 358 0 None closed Bug 1880990: Fix syntax error in conformance test. 2020-10-06 08:17:16 UTC
Github openshift sriov-network-operator pull 360 0 None closed Bug 1880990: Skip vf allocation in case of discovery mode. 2020-10-06 08:17:16 UTC
Github openshift sriov-network-operator pull 361 0 None closed Bug 1880990: Move the skip inside an It context 2020-10-06 08:17:17 UTC
Red Hat Product Errata RHBA-2020:4196 0 None None None 2020-10-27 16:43:22 UTC

Description Sebastian Scheinkman 2020-09-21 11:11:45 UTC
Description of problem:
Multiple CNF tests are failing.

* SRIOV test fail in BeforeEach
* SRIOV macvlan test
* When using ovn-kubernetes with shared gw mode the PF-Shutdown tests take down the node.
* PTP metrics test failed

Comment 5 Nikita 2020-09-23 11:36:32 UTC
This issue is still relevant. After running these tests with openshift4-cnf-tests:rhaos-4.6-rhel-8-containers-candidate-22026-20200922093002 
Below is tests output:
00:53:08 [Fail] [rfe_id:27363][performance] CPU Management Verification of configuration on the worker node [It] [test_id:34358] Verify rcu_nocbs kernel argument on the node 
00:53:08 /remote-source/app/vendor/github.com/openshift-kni/performance-addon-operators/functests/1_performance/cpu_management.go:141
00:53:08 
00:53:08 [Fail] [sriov] operator Generic SriovNetworkNodePolicy [BeforeEach] Resource Injector Should inject downward api volume 
00:53:08 /remote-source/app/vendor/github.com/openshift/sriov-network-operator/test/conformance/tests/sriov_operator.go:1764
00:53:08 
00:53:08 [Fail] [sriov] operator Generic SriovNetworkNodePolicy VF flags [BeforeEach] Should configure the spoofChk boolean variable 
00:53:08 /remote-source/app/vendor/github.com/openshift/sriov-network-operator/test/conformance/tests/sriov_operator.go:320
00:53:08 
00:53:08 [Fail] [sriov] operator Generic SriovNetworkNodePolicy VF flags [BeforeEach] Should configure the trust boolean variable 
00:53:08 /remote-source/app/vendor/github.com/openshift/sriov-network-operator/test/conformance/tests/sriov_operator.go:320
00:53:08 
00:53:08 [Fail] [sriov] operator Generic SriovNetworkNodePolicy VF flags [BeforeEach] Should configure the the link state variable 
00:53:08 /remote-source/app/vendor/github.com/openshift/sriov-network-operator/test/conformance/tests/sriov_operator.go:320
00:53:08 
00:53:08 [Fail] [sriov] operator Generic SriovNetworkNodePolicy VF flags [BeforeEach] rate limit Should configure the requested rate limit flags under the vf 
00:53:08 /remote-source/app/vendor/github.com/openshift/sriov-network-operator/test/conformance/tests/sriov_operator.go:320
00:53:08 
00:53:08 [Fail] [sriov] operator Generic SriovNetworkNodePolicy VF flags [BeforeEach] vlan and Qos vlan Should configure the requested vlan and Qos vlan flags under the vf 
00:53:08 /remote-source/app/vendor/github.com/openshift/sriov-network-operator/test/conformance/tests/sriov_operator.go:320
00:53:08 
00:53:08 [Panic!] [sriov] operator Generic SriovNetworkNodePolicy Multiple sriov device and attachment [It] Should configure multiple network attachments 
00:53:08 /opt/rh/go-toolset-1.13/root/usr/lib/go-toolset-1.13-golang/src/runtime/panic.go:199
00:53:08 
00:53:08 [Panic!] [sriov] operator Generic SriovNetworkNodePolicy IPv6 configured secondary interfaces on pods [It] should be able to ping each other 
00:53:08 /opt/rh/go-toolset-1.13/root/usr/lib/go-toolset-1.13-golang/src/runtime/panic.go:199
00:53:08 
00:53:08 [Panic!] [sriov] operator Generic SriovNetworkNodePolicy NAD update [It] NAD is updated when SriovNetwork spec/networkNamespace is changed 
00:53:08 /opt/rh/go-toolset-1.13/root/usr/lib/go-toolset-1.13-golang/src/runtime/panic.go:199
00:53:08 
00:53:08 [Panic!] [sriov] operator Generic SriovNetworkNodePolicy NAD update [It] NAD default gateway is updated when SriovNetwork ipam is changed 
00:53:08 /opt/rh/go-toolset-1.13/root/usr/lib/go-toolset-1.13-golang/src/runtime/panic.go:199
00:53:08 
00:53:08 [Panic!] [sriov] operator Generic SriovNetworkNodePolicy SRIOV and macvlan [It] Should be able to create a pod with both sriov and macvlan interfaces 
00:53:08 /opt/rh/go-toolset-1.13/root/usr/lib/go-toolset-1.13-golang/src/runtime/panic.go:199
00:53:08 
00:53:08 [Fail] [sriov] operator Generic SriovNetworkNodePolicy Virtual Functions [It] should release the VFs once the pod deleted and same VFs can be used by the new created pods 
00:53:08 /remote-source/app/vendor/github.com/openshift/sriov-network-operator/test/conformance/tests/sriov_operator.go:748
00:53:08 

Move back to "ASSIGNED"

Comment 6 Federico Simoncelli 2020-09-24 09:55:37 UTC
What is the latest status on this? Are we working with Nikita on understanding why this Failed QA? Do we need more fixes?

Comment 7 Federico Paolinelli 2020-09-24 09:57:52 UTC
Last run with the fixes is better, but there are still 5 sriov failures.
I am working with Nikita, I am suspecting a bug in the operator, I am treating it with high priority.

Comment 13 Nikita 2020-09-30 06:18:58 UTC
Verified with registry-proxy.engineering.redhat.com/rh-osbs/openshift4-cnf-tests:v4.6.0-11 . All network tests are stable. Move this bug to verified

Comment 16 errata-xmlrpc 2020-10-27 16:42:58 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4196


Note You need to log in before you can comment on or make changes to this bug.