Bug 2139699

Summary: kubernetes-nmstate-operator deletes Virtual Functions created by sriov-fec-operator [rhel-8.6.0.z]
Product: Red Hat Enterprise Linux 8 Reporter: RHEL Program Management Team <pgm-rhel-tools>
Component: nmstateAssignee: Fernando F. Mancera <ferferna>
Status: CLOSED ERRATA QA Contact: Mingyu Shi <mshi>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 8.4CC: eglottma, ellorent, ferferna, fge, jiji, jishi, mori, mshi, network-qe, pibanezr, sfaye, till, tkimura, yuokada
Target Milestone: rcKeywords: Triaged, ZStream
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 2105141 Environment:
Last Closed: 2022-12-06 09:53:50 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 2105141    
Bug Blocks:    

Comment 6 Mingyu Shi 2022-11-16 11:33:39 UTC 
Verified with:
nmstate-1.2.1-6.el8_6.x86_64
nispor-1.2.3-1.el8.x86_64
NetworkManager-1.36.0-9.el8_6.x86_64
DISTRO=RHEL-8.6.0-updates-20221115.0

VFs are not touched when `sr-iov` subtree is not mentioned in the desired state.
But it needs to mention that if sriov configuration is written in NM connection:
sriov.total-vfs:                        4
sriov.vfs:                              0 mac=00:00:00:00:00:00 max-tx-rate=0 min-tx-rate=0 spoof-check=false trust=false, 1 mac=00:00:00:00:00:00 max-tx-rate=0 min-tx-rate=0 spoof-check=false trust=false, 2 mac=00:00:00:00:00:00 max-tx-rate=0 min-tx-rate=0 spoof-check=false trust=false, 3 mac=00:00:00:00:00:00 max-tx-rate=0 min-tx-rate=0 spoof-check=false trust=false

Removing the connection, or applied "state: absent", the VFs in the connection would be removed too.


[19:28:35@dell-per740-34 ~]0# echo 4 > /sys/class/net/ens3f0/device/sriov_numvfs 
[19:29:09@dell-per740-34 ~]0# echo 4 > /sys/class/net/ens3f1/device/sriov_numvfs 
[19:29:53@dell-per740-34 ~]0# ip l
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:54 brd ff:ff:ff:ff:ff:ff
3: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:55 brd ff:ff:ff:ff:ff:ff
4: eno3: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:56 brd ff:ff:ff:ff:ff:ff
5: eno4: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:57 brd ff:ff:ff:ff:ff:ff
6: ens1f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:10:18:f1:62:60 brd ff:ff:ff:ff:ff:ff
7: ens3f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:8a:d6:e0 brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 1     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 2     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 3     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
8: ens3f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:8a:d6:e1 brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 1     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 2     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 3     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
9: ens1f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:10:18:f1:62:62 brd ff:ff:ff:ff:ff:ff
10: eth0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether ba:67:3f:cc:83:63 brd ff:ff:ff:ff:ff:ff
11: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether fe:ca:fe:76:88:71 brd ff:ff:ff:ff:ff:ff
12: eth2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 4a:55:5a:69:83:16 brd ff:ff:ff:ff:ff:ff
13: eth3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 66:44:a0:e6:91:c5 brd ff:ff:ff:ff:ff:ff
14: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 1a:ef:17:d4:ae:b4 brd ff:ff:ff:ff:ff:ff
15: eth5: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 56:f1:63:97:cc:1b brd ff:ff:ff:ff:ff:ff
16: eth6: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether a6:3b:f4:eb:d5:cc brd ff:ff:ff:ff:ff:ff
17: eth7: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether ca:df:fb:d8:0f:57 brd ff:ff:ff:ff:ff:ff
[19:29:55@dell-per740-34 ~]0# nmstatectl set vf.yaml 
/tmp/nmstatelog/2022-11-16-19:30:07-945572324.log
Desired state applied: 
---
interfaces:
- name: ens3f0
  type: ethernet
  state: up
  description: vf test 1
  ipv4:
    enabled: true
    address:
    - ip: 192.168.199.1
      prefix-length: 24
  ipv6:
    enabled: true
    address:
    - ip: 192:168:199::1
      prefix-length: 64
  mtu: 2000
- name: ens3f1
  type: ethernet
  state: up
  description: vf test 2
  ipv4:
    enabled: true
    address:
    - ip: 192.168.199.2
      prefix-length: 24
  ipv6:
    enabled: true
    address:
    - ip: 192:168:199::2
      prefix-length: 64
  mtu: 2000
/tmp/nmstatelog/2022-11-16-19:30:07-945572324.0.log nmstatectl set vf.yaml return 0
[19:30:16@dell-per740-34 ~]0# ip l
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:54 brd ff:ff:ff:ff:ff:ff
3: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:55 brd ff:ff:ff:ff:ff:ff
4: eno3: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:56 brd ff:ff:ff:ff:ff:ff
5: eno4: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:57 brd ff:ff:ff:ff:ff:ff
6: ens1f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:10:18:f1:62:60 brd ff:ff:ff:ff:ff:ff
7: ens3f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2000 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:8a:d6:e0 brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 1     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 2     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 3     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
8: ens3f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2000 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:8a:d6:e1 brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 1     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 2     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 3     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
9: ens1f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:10:18:f1:62:62 brd ff:ff:ff:ff:ff:ff
10: eth0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether ba:67:3f:cc:83:63 brd ff:ff:ff:ff:ff:ff
11: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether fe:ca:fe:76:88:71 brd ff:ff:ff:ff:ff:ff
12: eth2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 4a:55:5a:69:83:16 brd ff:ff:ff:ff:ff:ff
13: eth3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 66:44:a0:e6:91:c5 brd ff:ff:ff:ff:ff:ff
14: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 1a:ef:17:d4:ae:b4 brd ff:ff:ff:ff:ff:ff
15: eth5: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 56:f1:63:97:cc:1b brd ff:ff:ff:ff:ff:ff
16: eth6: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether a6:3b:f4:eb:d5:cc brd ff:ff:ff:ff:ff:ff
17: eth7: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether ca:df:fb:d8:0f:57 brd ff:ff:ff:ff:ff:ff
[19:30:21@dell-per740-34 ~]0# nmstatectl show ens3f[01]
2022-11-16 19:30:31,787 root         DEBUG    NetworkManager version 1.36.0
2022-11-16 19:30:31,789 root         DEBUG    Async action: Retrieve applied config: ethernet eno1 started
2022-11-16 19:30:31,789 root         DEBUG    Async action: Retrieve applied config: ethernet ens3f0 started
2022-11-16 19:30:31,790 root         DEBUG    Async action: Retrieve applied config: ethernet ens3f1 started
2022-11-16 19:30:31,791 root         DEBUG    Async action: Retrieve applied config: ethernet eno1 finished
2022-11-16 19:30:31,792 root         DEBUG    Async action: Retrieve applied config: ethernet ens3f0 finished
2022-11-16 19:30:31,792 root         DEBUG    Async action: Retrieve applied config: ethernet ens3f1 finished
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eno1 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.ens3f0 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.ens3f1 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eth0 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eth1 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eth2 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eth3 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eth4 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eth5 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eth6 found. Merging the interface information.
2022-11-16 19:30:31,794 root         DEBUG    Interface ethernet.eth7 found. Merging the interface information.
---
dns-resolver:
  config: {}
  running:
    search:
    - rhts.eng.pek2.redhat.com
    server:
    - 10.11.5.19
    - 10.72.17.5
    - 10.68.5.26
route-rules:
  config: []
routes:
  config: []
  running:
  - destination: 192:168:199::/64
    metric: 101
    next-hop-address: '::'
    next-hop-interface: ens3f0
    table-id: 254
  - destination: 192:168:199::/64
    metric: 102
    next-hop-address: '::'
    next-hop-interface: ens3f1
    table-id: 254
  - destination: fe80::/64
    metric: 1024
    next-hop-address: '::'
    next-hop-interface: ens3f0
    table-id: 254
  - destination: fe80::/64
    metric: 1024
    next-hop-address: '::'
    next-hop-interface: ens3f1
    table-id: 254
  - destination: 192.168.199.0/24
    metric: 101
    next-hop-address: 0.0.0.0
    next-hop-interface: ens3f0
    table-id: 254
  - destination: 192.168.199.0/24
    metric: 102
    next-hop-address: 0.0.0.0
    next-hop-interface: ens3f1
    table-id: 254
interfaces:
- name: ens3f0
  type: ethernet
  state: up
  accept-all-mac-addresses: false
  description: vf test 1
  ethernet:
    auto-negotiation: true
    duplex: full
    speed: 10000
    sr-iov:
      total-vfs: 4
      vfs:
      - _vf_iface_name: eth0
        id: 0
        mac-address: 00:00:00:00:00:00
        max-tx-rate: 0
        min-tx-rate: 0
        qos: 0
        spoof-check: true
        trust: false
        vlan-id: 0
      - _vf_iface_name: eth1
        id: 1
        mac-address: 00:00:00:00:00:00
        max-tx-rate: 0
        min-tx-rate: 0
        qos: 0
        spoof-check: true
        trust: false
        vlan-id: 0
      - _vf_iface_name: eth2
        id: 2
        mac-address: 00:00:00:00:00:00
        max-tx-rate: 0
        min-tx-rate: 0
        qos: 0
        spoof-check: true
        trust: false
        vlan-id: 0
      - _vf_iface_name: eth3
        id: 3
        mac-address: 00:00:00:00:00:00
        max-tx-rate: 0
        min-tx-rate: 0
        qos: 0
        spoof-check: true
        trust: false
        vlan-id: 0
  ethtool:
    coalesce:
      rx-usecs: 1
      tx-usecs: 0
    feature:
      esp-hw-offload: true
      esp-tx-csum-hw-offload: true
      hw-tc-offload: false
      l2-fwd-offload: false
      rx-all: false
      rx-checksum: true
      rx-gro: true
      rx-gro-list: false
      rx-hashing: true
      rx-lro: false
      rx-ntuple-filter: false
      rx-udp-gro-forwarding: false
      rx-udp_tunnel-port-offload: true
      rx-vlan-filter: true
      rx-vlan-hw-parse: true
      tx-checksum-ip-generic: true
      tx-checksum-sctp: true
      tx-esp-segmentation: true
      tx-generic-segmentation: true
      tx-gre-csum-segmentation: true
      tx-gre-segmentation: true
      tx-gso-partial: true
      tx-ipxip4-segmentation: true
      tx-ipxip6-segmentation: true
      tx-nocache-copy: false
      tx-tcp-mangleid-segmentation: false
      tx-tcp-segmentation: true
      tx-tcp6-segmentation: true
      tx-udp-segmentation: true
      tx-udp_tnl-csum-segmentation: true
      tx-udp_tnl-segmentation: true
      tx-vlan-hw-insert: true
    pause:
      autoneg: false
      rx: true
      tx: true
    ring:
      rx: 512
      tx: 512
  ipv4:
    enabled: true
    address:
    - ip: 192.168.199.1
      prefix-length: 24
    dhcp: false
  ipv6:
    enabled: true
    address:
    - ip: 192:168:199::1
      prefix-length: 64
    - ip: fe80::92e2:baff:fe8a:d6e0
      prefix-length: 64
    autoconf: false
    dhcp: false
  lldp:
    enabled: false
  mac-address: 90:E2:BA:8A:D6:E0
  mtu: 2000
- name: ens3f1
  type: ethernet
  state: up
  accept-all-mac-addresses: false
  description: vf test 2
  ethernet:
    auto-negotiation: true
    duplex: full
    speed: 10000
    sr-iov:
      total-vfs: 4
      vfs:
      - _vf_iface_name: eth4
        id: 0
        mac-address: 00:00:00:00:00:00
        max-tx-rate: 0
        min-tx-rate: 0
        qos: 0
        spoof-check: true
        trust: false
        vlan-id: 0
      - _vf_iface_name: eth5
        id: 1
        mac-address: 00:00:00:00:00:00
        max-tx-rate: 0
        min-tx-rate: 0
        qos: 0
        spoof-check: true
        trust: false
        vlan-id: 0
      - _vf_iface_name: eth6
        id: 2
        mac-address: 00:00:00:00:00:00
        max-tx-rate: 0
        min-tx-rate: 0
        qos: 0
        spoof-check: true
        trust: false
        vlan-id: 0
      - _vf_iface_name: eth7
        id: 3
        mac-address: 00:00:00:00:00:00
        max-tx-rate: 0
        min-tx-rate: 0
        qos: 0
        spoof-check: true
        trust: false
        vlan-id: 0
  ethtool:
    coalesce:
      rx-usecs: 1
      tx-usecs: 0
    feature:
      esp-hw-offload: true
      esp-tx-csum-hw-offload: true
      hw-tc-offload: false
      l2-fwd-offload: false
      rx-all: false
      rx-checksum: true
      rx-gro: true
      rx-gro-list: false
      rx-hashing: true
      rx-lro: false
      rx-ntuple-filter: false
      rx-udp-gro-forwarding: false
      rx-udp_tunnel-port-offload: true
      rx-vlan-filter: true
      rx-vlan-hw-parse: true
      tx-checksum-ip-generic: true
      tx-checksum-sctp: true
      tx-esp-segmentation: true
      tx-generic-segmentation: true
      tx-gre-csum-segmentation: true
      tx-gre-segmentation: true
      tx-gso-partial: true
      tx-ipxip4-segmentation: true
      tx-ipxip6-segmentation: true
      tx-nocache-copy: false
      tx-tcp-mangleid-segmentation: false
      tx-tcp-segmentation: true
      tx-tcp6-segmentation: true
      tx-udp-segmentation: true
      tx-udp_tnl-csum-segmentation: true
      tx-udp_tnl-segmentation: true
      tx-vlan-hw-insert: true
    pause:
      autoneg: false
      rx: true
      tx: true
    ring:
      rx: 512
      tx: 512
  ipv4:
    enabled: true
    address:
    - ip: 192.168.199.2
      prefix-length: 24
    dhcp: false
  ipv6:
    enabled: true
    address:
    - ip: 192:168:199::2
      prefix-length: 64
    - ip: fe80::92e2:baff:fe8a:d6e1
      prefix-length: 64
    autoconf: false
    dhcp: false
  lldp:
    enabled: false
  mac-address: 90:E2:BA:8A:D6:E1
  mtu: 2000
ovs-db:
  external_ids:
    hostname: dell-per740-34.rhts.eng.pek2.redhat.com
    rundir: /var/run/openvswitch
    system-id: 223b90e9-c1c0-47de-b026-4eec92e0b11c
  other_config: {}
[19:30:31@dell-per740-34 ~]0# rmiface ens3f[01]
ens3f[01]
/tmp/nmstatelog/2022-11-16-19:30:43-047017748.log
Desired state applied: 
---
interfaces:
- name: ens3f0
  type: ethernet
  state: absent
- name: ens3f1
  type: ethernet
  state: absent
/tmp/nmstatelog/2022-11-16-19:30:43-047017748.0.log nmstatectl set /tmp/rmiface_temp.yaml return 0
[19:30:48@dell-per740-34 ~]0# ip l
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:54 brd ff:ff:ff:ff:ff:ff
3: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:55 brd ff:ff:ff:ff:ff:ff
4: eno3: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:56 brd ff:ff:ff:ff:ff:ff
5: eno4: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 20:04:0f:fa:32:57 brd ff:ff:ff:ff:ff:ff
6: ens1f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:10:18:f1:62:60 brd ff:ff:ff:ff:ff:ff
7: ens3f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:8a:d6:e0 brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 1     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 2     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 3     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
8: ens3f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:8a:d6:e1 brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 1     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 2     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
    vf 3     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust off, query_rss off
9: ens1f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:10:18:f1:62:62 brd ff:ff:ff:ff:ff:ff
10: eth0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether ba:67:3f:cc:83:63 brd ff:ff:ff:ff:ff:ff
11: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether fe:ca:fe:76:88:71 brd ff:ff:ff:ff:ff:ff
12: eth2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 4a:55:5a:69:83:16 brd ff:ff:ff:ff:ff:ff
13: eth3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 66:44:a0:e6:91:c5 brd ff:ff:ff:ff:ff:ff
14: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 1a:ef:17:d4:ae:b4 brd ff:ff:ff:ff:ff:ff
15: eth5: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 56:f1:63:97:cc:1b brd ff:ff:ff:ff:ff:ff
16: eth6: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether a6:3b:f4:eb:d5:cc brd ff:ff:ff:ff:ff:ff
17: eth7: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether ca:df:fb:d8:0f:57 brd ff:ff:ff:ff:ff:ff
Comment 10 errata-xmlrpc 2022-12-06 09:53:50 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (nmstate bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:8803