Bug 2151624
| Summary: | SR-IOV VF parameter configuration fails | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Product: | Red Hat Enterprise Linux 9 | Reporter: | Carlos Goncalves <cgoncalves> | ||||||||
| Component: | nmstate | Assignee: | Gris Ge <fge> | ||||||||
| Status: | CLOSED ERRATA | QA Contact: | Mingyu Shi <mshi> | ||||||||
| Severity: | medium | Docs Contact: | |||||||||
| Priority: | high | ||||||||||
| Version: | 9.0 | CC: | ferferna, jiji, jishi, network-qe, sfaye, till | ||||||||
| Target Milestone: | rc | Keywords: | Triaged | ||||||||
| Target Release: | --- | Flags: | pm-rhel:
mirror+
|
||||||||
| Hardware: | Unspecified | ||||||||||
| OS: | Unspecified | ||||||||||
| Whiteboard: | |||||||||||
| Fixed In Version: | nmstate-2.2.3-2.el9 | Doc Type: | If docs needed, set a value | ||||||||
| Doc Text: | Story Points: | --- | |||||||||
| Clone Of: | Environment: | ||||||||||
| Last Closed: | 2023-05-09 07:31:50 UTC | Type: | Bug | ||||||||
| Regression: | --- | Mount Type: | --- | ||||||||
| Documentation: | --- | CRM: | |||||||||
| Verified Versions: | Category: | --- | |||||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||||
| Embargoed: | |||||||||||
| Attachments: |
|
||||||||||
Created attachment 1930858 [details]
journalctl log
Created attachment 1930859 [details]
knmstate policy failure log
Created attachment 1930860 [details]
knmstate policy CR
Hi Carlos,
Could you try:
```
apiVersion: nmstate.io/v1
kind: NodeNetworkConfigurationPolicy
metadata:
name: sriov-vf3-trust-policy
spec:
nodeSelector:
kubernetes.io/hostname: "cnfdc8-worker-1"
desiredState:
interfaces:
- name: ens1f0
type: ethernet
ethernet:
sr-iov:
total-vfs: 4
vfs:
- id: 0
- id: 1
- id: 2
- id: 3
trust: true
```
Gris, that helped.
# oc get nncp
NAME STATUS REASON
sriov-vf3-trust-policy Available SuccessfullyConfigured
# ip link show ens1f0
2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
link/ether 64:4c:36:11:c6:e0 brd ff:ff:ff:ff:ff:ff
vf 0 link/ether 6a:ec:6b:a5:03:ea brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off
vf 1 link/ether 1a:07:3e:b9:34:e3 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off
vf 2 link/ether 86:70:73:75:d3:27 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off
vf 3 link/ether a2:93:0d:97:64:0c brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust on
Hi Carlos, Thanks for the confirmation! I will patch nmstate to be smart on auto convert your original desire state to what I mentioned in comment #5. Patch send to upstream: https://github.com/nmstate/nmstate/pull/2165 For VF config * `vfs: []` will revert all VF configs back to default. * Non-empty `vfs` will merge with current for undefined VF. New patch send to upstream: https://github.com/nmstate/nmstate/pull/2241 The fix will shipped by next rebase build. Verified with: nmstate-2.2.7-1.el9.x86_64 nispor-1.2.10-1.el9.x86_64 NetworkManager-1.42.0-1.el9.x86_64 openvswitch2.15-2.15.0-79.el9fdp.x86_64 Linux dell-per740-68.rhts.eng.pek2.redhat.com 5.14.0-252.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Feb 1 09:46:00 EST 2023 x86_64 x86_64 x86_64 GNU/Linux Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (nmstate bug fix and enhancement update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2023:2190 |
Description of problem: As an OpenShift user, I want to configure my SR-IOV NIC with 4 virtual functions and set the fourth one (index 3) with trust on. I use Kubernetes-nmstate with the desired network configuration (see NodeNetworkConfigurationPolicy CR file attached). nmstatectl returns an error. For about a minute, the four VFs are created and VF 3 is set to trust on as desired: # ip link show ens1f0 2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 64:4c:36:11:c6:e0 brd ff:ff:ff:ff:ff:ff vf 0 link/ether 6a:ec:6b:a5:03:ea brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off vf 1 link/ether 1a:07:3e:b9:34:e3 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off vf 2 link/ether 86:70:73:75:d3:27 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off vf 3 link/ether a2:93:0d:97:64:0c brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust on This configuration is rolled back by NetworkManager in approximately 1 minute. Version-Release number of selected component (if applicable): - Red Hat Enterprise Linux CoreOS 412.86.202212030032-0 - Kernel 4.18.0-372.32.1.el8_6.x86_64 - OpenShift 4.12.0-0.nightly-2022-12-03-062812 How reproducible: 100% Steps to Reproduce: 1. oc apply -f knmstate-sriov-vf3-trust-policy.yaml 2. 3. Actual results: See journalctl and k-nmstate failure log files attached. # oc get nnce NAME STATUS REASON cnfdc8-worker-1sriov-vf3-trust-policy Failing FailedToConfigure