2210253 – [dpdk]pf dpdk impact vf dpdk test

Bug 2210253 - [dpdk]pf dpdk impact vf dpdk test [NEEDINFO]

Summary: [dpdk]pf dpdk impact vf dpdk test

Keywords:
Status:	NEW
Alias:	None
Product:	Red Hat Enterprise Linux Fast Datapath
Classification:	Red Hat
Component:	DPDK
Sub Component:
Version:	RHEL 9.0
Hardware:	x86_64
OS:	Linux
Priority:	unspecified
Severity:	high
Target Milestone:	---
Target Release:	---
Assignee:	Kevin Traynor
QA Contact:	mhou
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2023-05-26 09:45 UTC by mhou
Modified:	2023-07-13 07:25 UTC (History)
CC List:	7 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:
Embargoed:
Flags:	mhou: needinfo? (ktraynor)

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Red Hat Issue Tracker	FD-2904	0	None	None	None	2023-05-26 09:47:09 UTC

Description mhou 2023-05-26 09:45:37 UTC

Description of problem:

Design two tests, the first test will use pf to forward package. The second test will use vf to forward package. VF forward 2000/9000 mtu failed.


Version-Release number of selected component (if applicable):
kernel version:5.14.0-284.11.1.el9_2.x86_64
dpdk version: dpdk-22.11-3.el9_2.x86_64
dpdk-tools-22.11-3.el9_2.x86_64
driverctl version: driverctl-0.111-2.el9.noarch
# ethtool -i ens2f0
driver: i40e
version: 5.14.0-284.11.1.el9_2.x86_64
firmware-version: 9.20 0x8000d960 22.0.9
expansion-rom-version: 
bus-info: 0000:5e:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

How reproducible: 100%


Steps to Reproduce:
1. create test script as below:
#!/bin/bash
modprobe vfio
modprobe vfio-pci
ethtool -i ens2f0
ethtool -i ens2f1
ip link set ens2f0 up
ip link set ens2f1 up
ip link set ens2f0 mtu 9600
ip link set ens2f1 mtu 9600
driverctl set-override 0000:5e:00.0 vfio-pci
driverctl set-override 0000:5e:00.1 vfio-pci
nohup sh -c '(while sleep 1; do echo show port stats all; done | dpdk-testpmd  --log-level="*:debug" -l 42,44,46 -a 0000:5e:00.0 -a 0000:5e:00.1 -n 4 --socket-mem 1024,1024 -- -i --nb-cores=2 --txq=1 --rxq=1 --forward-mode=io --auto-start)' &>/tmp/testpmd_pf.log &
sshpass -p redhat ssh -X -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ConnectTimeout=10 root.89.16 \
"/opt/trafficgen/binary-search.py --traffic-generator=trex-txrx --frame-size=64 --num-flows=1024 \
--max-loss-pct=0 --search-runtime=10 --validation-runtime=10 --rate-tolerance=10 \
--runtime-tolerance=10 --rate=25 --rate-unit=% --duplicate-packet-failure=retry-to-fail \
--negative-packet-loss=retry-to-fail  --one-shot=1 --use-src-ip-flows=1 --use-dst-ip-flows=1 \
--use-src-mac-flows=1 --use-dst-mac-flows=1 --sniff-runtime=10 --warmup-trial --warmup-trial-runtime=10 \
--send-teaching-measurement --send-teaching-warmup --teaching-warmup-packet-type=generic \
--teaching-warmup-packet-rate=10000 --teaching-measurement-packet-type=generic --use-device-stats"
pkill -9 dpdk-testpmd
rm -rf /dev/hugepages/*
sleep 3
driverctl unset-override 0000:5e:00.0
driverctl unset-override 0000:5e:00.1
sleep 3
ip link set ens2f0 down
ip link set ens2f1 down
ip link set ens2f0 up
ip link set ens2f1 up
ip link set ens2f0 mtu 9600
ip link set ens2f1 mtu 9600
echo 0 > /sys/bus/pci/devices/0000:5e:00.0/sriov_numvfs
echo 0 > /sys/bus/pci/devices/0000:5e:00.1/sriov_numvfs

echo 1 > /sys/bus/pci/devices/0000:5e:00.0/sriov_numvfs
echo 1 > /sys/bus/pci/devices/0000:5e:00.1/sriov_numvfs
ip link set ens2f0 vf 0 spoofchk off
ip link set ens2f0 vf 0 trust on

ip link set ens2f1 vf 0 spoofchk off
ip link set ens2f1 vf 0 trust on
sleep 3
ip link set ens2f0v0 mtu 9600
ip link set ens2f1v0 mtu 9600
ip link show ens2f0
ip link show ens2f1
ip link show ens2f0v0
ip link show ens2f1v0
ethtool -i ens2f0v0
ethtool -i ens2f1v0
driverctl set-override 0000:5e:02.0 vfio-pci
driverctl set-override 0000:5e:0a.0 vfio-pci
nohup sh -c '(while sleep 1; do echo show port stats all; echo show port info all;  done | dpdk-testpmd  --log-level="*:debug" -l 42,44,46 -a 0000:5e:02.0 -a 0000:5e:0a.0 -n 4 --socket-mem 4096,4096 -- -i --forward-mode=io --max-pkt-len=9120 --mbuf-size=9728 --nb-cores=2 --rxq=1 --txq=1 --auto-start)' &>/tmp/testpmd_vf.log &

sshpass -p redhat ssh -X -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ConnectTimeout=10 root.89.16 \
"/opt/trafficgen/binary-search.py --traffic-generator=trex-txrx --frame-size=9000 --num-flows=1024 \
--max-loss-pct=0 --search-runtime=10 --validation-runtime=10 --rate-tolerance=10 \
--runtime-tolerance=10 --rate=25 --rate-unit=% --duplicate-packet-failure=retry-to-fail \
--negative-packet-loss=retry-to-fail  --one-shot=1 --use-src-ip-flows=1 --use-dst-ip-flows=1 \
--use-src-mac-flows=1 --use-dst-mac-flows=1 --sniff-runtime=10 --warmup-trial --warmup-trial-runtime=10 \
--send-teaching-measurement --send-teaching-warmup --teaching-warmup-packet-type=generic \
--teaching-warmup-packet-rate=10000 --teaching-measurement-packet-type=generic --use-device-stats"
sshpass -p redhat ssh -X -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ConnectTimeout=10 root.89.16 \
"/opt/trafficgen/binary-search.py --traffic-generator=trex-txrx --frame-size=1501 --num-flows=1024 \
--max-loss-pct=0 --search-runtime=10 --validation-runtime=10 --rate-tolerance=10 \
--runtime-tolerance=10 --rate=25 --rate-unit=% --duplicate-packet-failure=retry-to-fail \
--negative-packet-loss=retry-to-fail  --one-shot=1 --use-src-ip-flows=1 --use-dst-ip-flows=1 \
--use-src-mac-flows=1 --use-dst-mac-flows=1 --sniff-runtime=10 --warmup-trial --warmup-trial-runtime=10 \
--send-teaching-measurement --send-teaching-warmup --teaching-warmup-packet-type=generic \
--teaching-warmup-packet-rate=10000 --teaching-measurement-packet-type=generic --use-device-stats"

pkill -9 dpdk-testpmd

echo 0 > /sys/bus/pci/devices/0000:5e:00.0/sriov_numvfs
echo 0 > /sys/bus/pci/devices/0000:5e:00.1/sriov_numvfs
rm -rf /dev/hugepages/*

2. run test script and found vf forward traffic with 9000 failed. But run mtu with 1501 with pass.
output of mtu 9000 test
[2023-05-26 05:40:33.681916][BSO] Device Pair: 0->1 |   All TX   | packets=877,154 rate=87,221.04854107887 l1_bps=6,286,591,748.090175 l2_bps=6,269,845,306.7702875
[2023-05-26 05:40:33.681925][BSO] Device Pair: 0->1 |   All RX   | packets=1,024 rate=101.82288823406695 l1_bps=68,424.98089329299 l2_bps=48,874.98635235214
[2023-05-26 05:40:33.681967][BSO] Device Pair: 0->1 | Latency TX | packets=10,000 rate=994.3641429108102 l1_bps=71,753,316.55244406 l2_bps=71,562,398.63700518
[2023-05-26 05:40:33.681975][BSO] Device Pair: 0->1 | Latency RX | packets=0 rate=0.0 l1_bps=0.0 l2_bps=0.0 average=-1.0 minimum=0.0 maximum=0.0
[2023-05-26 05:40:33.681993][BSO] Device Pair: 1->0 |   All TX   | packets=877,154 rate=87,221.04854107887 l1_bps=6,286,591,748.090175 l2_bps=6,269,845,306.7702875
[2023-05-26 05:40:33.681999][BSO] Device Pair: 1->0 |   All RX   | packets=1,024 rate=101.82288823406695 l1_bps=68,424.98089329299 l2_bps=48,874.98635235214
[2023-05-26 05:40:33.682029][BSO] Device Pair: 1->0 | Latency TX | packets=10,000 rate=994.3641429108102 l1_bps=71,753,316.55244406 l2_bps=71,562,398.63700518
[2023-05-26 05:40:33.682035][BSO] Device Pair: 1->0 | Latency RX | packets=0 rate=0.0 l1_bps=0.0 l2_bps=0.0 average=-1.0 minimum=0.0 maximum=0.0
[2023-05-26 05:40:33.694057][002] Connection severed
[2023-05-26 05:40:33.738732][BSO] tg return code: 0
[2023-05-26 05:40:33.738734][BSO] Traffic generator set trial start time
[2023-05-26 05:40:33.738736][BSO] Traffic generator set trial stop time
[2023-05-26 05:40:33.738794][BSO] (Evaluating trial)
[2023-05-26 05:40:33.738801][BSO] 	(critical requirement failure, individual stream 100% RX packet loss , device pair: 0 -> 1, pg_ids: [64], trial result: abort)
[2023-05-26 05:40:33.738805][BSO] 	(critical requirement failure, individual stream 100% RX packet loss , device pair: 1 -> 0, pg_ids: [191], trial result: abort)
[2023-05-26 05:40:33.738814][BSO] ERROR: (binary search aborting due to critical error, trial result: quit)
Warning: Permanently added '10.73.89.16' (ED25519) to the list of known hosts.


output of mtu 1501 test 
[2023-05-26 05:40:56.303396][BSO] RESULT:
[2023-05-26 05:40:56.303535][BSO] [
[2023-05-26 05:40:56.303535][BSO] {
[2023-05-26 05:40:56.303535][BSO]     "rx_l1_bps": 6231552156.381975,
[2023-05-26 05:40:56.303535][BSO]     "rx_l2_bps": 6133205433.246694,
[2023-05-26 05:40:56.303535][BSO]     "rx_packets": 5147447,
[2023-05-26 05:40:56.303535][BSO]     "rx_lost_packets": 0,
[2023-05-26 05:40:56.303535][BSO]     "rx_lost_packets_pct": 0.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_pps": 512222.51632959314,
[2023-05-26 05:40:56.303535][BSO]     "rx_lost_pps": 0.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_average": 27.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_packets": 10000,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_lost_packets": 0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_lost_packets_pct": 0.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_maximum": 44.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_minimum": 11.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_l1_bps": 12108378.345029078,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_l2_bps": 11917319.12064992,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_pps": 995.1001269747762,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_lost_pps": 0.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_active": true,
[2023-05-26 05:40:56.303535][BSO]     "tx_l1_bps": 6231552156.381975,
[2023-05-26 05:40:56.303535][BSO]     "tx_l2_bps": 6133205433.246694,
[2023-05-26 05:40:56.303535][BSO]     "tx_packets": 5147447,
[2023-05-26 05:40:56.303535][BSO]     "tx_pps": 512222.51632959314,
[2023-05-26 05:40:56.303535][BSO]     "tx_pps_target": 513642.3405654175,
[2023-05-26 05:40:56.303535][BSO]     "tx_latency_packets": 10000,
[2023-05-26 05:40:56.303535][BSO]     "tx_latency_l1_bps": 12108378.345029078,
[2023-05-26 05:40:56.303535][BSO]     "tx_latency_l2_bps": 11917319.12064992,
[2023-05-26 05:40:56.303535][BSO]     "tx_latency_pps": 995.1001269747762,
[2023-05-26 05:40:56.303535][BSO]     "tx_active": true,
[2023-05-26 05:40:56.303535][BSO]     "tx_tolerance_min": 462278.10650887573,
[2023-05-26 05:40:56.303535][BSO]     "tx_tolerance_max": 565006.5746219592
[2023-05-26 05:40:56.303535][BSO] }
[2023-05-26 05:40:56.303535][BSO] ,
[2023-05-26 05:40:56.303535][BSO] {
[2023-05-26 05:40:56.303535][BSO]     "rx_l1_bps": 6231552156.381975,
[2023-05-26 05:40:56.303535][BSO]     "rx_l2_bps": 6133205433.246694,
[2023-05-26 05:40:56.303535][BSO]     "rx_packets": 5147447,
[2023-05-26 05:40:56.303535][BSO]     "rx_lost_packets": 0,
[2023-05-26 05:40:56.303535][BSO]     "rx_lost_packets_pct": 0.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_pps": 512222.51632959314,
[2023-05-26 05:40:56.303535][BSO]     "rx_lost_pps": 0.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_average": 13.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_packets": 10000,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_lost_packets": 0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_lost_packets_pct": 0.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_maximum": 16.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_minimum": 11.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_l1_bps": 12108378.345029078,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_l2_bps": 11917319.12064992,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_pps": 995.1001269747762,
[2023-05-26 05:40:56.303535][BSO]     "rx_latency_lost_pps": 0.0,
[2023-05-26 05:40:56.303535][BSO]     "rx_active": true,
[2023-05-26 05:40:56.303535][BSO]     "tx_l1_bps": 6231552156.381975,
[2023-05-26 05:40:56.303535][BSO]     "tx_l2_bps": 6133205433.246694,
[2023-05-26 05:40:56.303535][BSO]     "tx_packets": 5147447,
[2023-05-26 05:40:56.303535][BSO]     "tx_pps": 512222.51632959314,
[2023-05-26 05:40:56.303535][BSO]     "tx_pps_target": 513642.3405654175,
[2023-05-26 05:40:56.303535][BSO]     "tx_latency_packets": 10000,
[2023-05-26 05:40:56.303535][BSO]     "tx_latency_l1_bps": 12108378.345029078,
[2023-05-26 05:40:56.303535][BSO]     "tx_latency_l2_bps": 11917319.12064992,
[2023-05-26 05:40:56.303535][BSO]     "tx_latency_pps": 995.1001269747762,
[2023-05-26 05:40:56.303535][BSO]     "tx_active": true,
[2023-05-26 05:40:56.303535][BSO]     "tx_tolerance_min": 462278.10650887573,
[2023-05-26 05:40:56.303535][BSO]     "tx_tolerance_max": 565006.5746219592
[2023-05-26 05:40:56.303535][BSO] }
[2023-05-26 05:40:56.303535][BSO] ]
[2023-05-26 05:40:56.303535][BSO] 


3. add --max-pkt-len=9120 --mbuf-size=9728 to the first pf test. and the second test(run with vf) will pass.
# cat work_fine_test.sh 
#!/bin/bash
set -x
modprobe vfio
modprobe vfio-pci
ethtool -i ens2f0
ethtool -i ens2f1
ip link set ens2f0 up
ip link set ens2f1 up
ip link set ens2f0 mtu 9600
ip link set ens2f1 mtu 9600
driverctl set-override 0000:5e:00.0 vfio-pci
driverctl set-override 0000:5e:00.1 vfio-pci
nohup sh -c '(while sleep 1; do echo show port stats all; done | dpdk-testpmd  --log-level="*:debug" -l 42,44,46 -a 0000:5e:00.0 -a 0000:5e:00.1 -n 4 --socket-mem 1024,1024 -- -i --max-pkt-len=9120 --mbuf-size=9728 --nb-cores=2 --txq=1 --rxq=1 --forward-mode=io --auto-start)' &>/tmp/testpmd_pf.log &
sshpass -p redhat ssh -X -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ConnectTimeout=10 root.89.16 \
"/opt/trafficgen/binary-search.py --traffic-generator=trex-txrx --frame-size=64 --num-flows=1024 \
--max-loss-pct=0 --search-runtime=10 --validation-runtime=10 --rate-tolerance=10 \
--runtime-tolerance=10 --rate=25 --rate-unit=% --duplicate-packet-failure=retry-to-fail \
--negative-packet-loss=retry-to-fail  --one-shot=1 --use-src-ip-flows=1 --use-dst-ip-flows=1 \
--use-src-mac-flows=1 --use-dst-mac-flows=1 --sniff-runtime=10 --warmup-trial --warmup-trial-runtime=10 \
--send-teaching-measurement --send-teaching-warmup --teaching-warmup-packet-type=generic \
--teaching-warmup-packet-rate=10000 --teaching-measurement-packet-type=generic --use-device-stats"
pkill -9 dpdk-testpmd
sleep 3
driverctl unset-override 0000:5e:00.0
driverctl unset-override 0000:5e:00.1
sleep 3
ip link set ens2f0 down
ip link set ens2f1 down
ip link set ens2f0 up
ip link set ens2f1 up
ip link set ens2f0 mtu 9600
ip link set ens2f1 mtu 9600
echo 0 > /sys/bus/pci/devices/0000:5e:00.0/sriov_numvfs
echo 0 > /sys/bus/pci/devices/0000:5e:00.1/sriov_numvfs

echo 1 > /sys/bus/pci/devices/0000:5e:00.0/sriov_numvfs
echo 1 > /sys/bus/pci/devices/0000:5e:00.1/sriov_numvfs
ip link set ens2f0 vf 0 spoofchk off
ip link set ens2f0 vf 0 trust on

ip link set ens2f1 vf 0 spoofchk off
ip link set ens2f1 vf 0 trust on
sleep 3
ip link set ens2f0v0 mtu 9600
ip link set ens2f1v0 mtu 9600
ip link show ens2f0
ip link show ens2f1
ip link show ens2f0v0
ip link show ens2f1v0
ethtool -i ens2f0v0
ethtool -i ens2f1v0
driverctl set-override 0000:5e:02.0 vfio-pci
driverctl set-override 0000:5e:0a.0 vfio-pci
nohup sh -c '(while sleep 1; do echo show port stats all; echo show port info all;  done | dpdk-testpmd  --log-level="*:debug" -l 42,44,46 -a 0000:5e:02.0 -a 0000:5e:0a.0 -n 4 --socket-mem 4096,4096 -- -i --forward-mode=io --max-pkt-len=9120 --mbuf-size=9728 --nb-cores=2 --rxq=1 --txq=1 --auto-start)' &>/tmp/testpmd_vf.log &

sshpass -p redhat ssh -X -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ConnectTimeout=10 root.89.16 \
"/opt/trafficgen/binary-search.py --traffic-generator=trex-txrx --frame-size=9000 --num-flows=1024 \
--max-loss-pct=0 --search-runtime=10 --validation-runtime=10 --rate-tolerance=10 \
--runtime-tolerance=10 --rate=25 --rate-unit=% --duplicate-packet-failure=retry-to-fail \
--negative-packet-loss=retry-to-fail  --one-shot=1 --use-src-ip-flows=1 --use-dst-ip-flows=1 \
--use-src-mac-flows=1 --use-dst-mac-flows=1 --sniff-runtime=10 --warmup-trial --warmup-trial-runtime=10 \
--send-teaching-measurement --send-teaching-warmup --teaching-warmup-packet-type=generic \
--teaching-warmup-packet-rate=10000 --teaching-measurement-packet-type=generic --use-device-stats"
sshpass -p redhat ssh -X -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ConnectTimeout=10 root.89.16 \
"/opt/trafficgen/binary-search.py --traffic-generator=trex-txrx --frame-size=1501 --num-flows=1024 \
--max-loss-pct=0 --search-runtime=10 --validation-runtime=10 --rate-tolerance=10 \
--runtime-tolerance=10 --rate=25 --rate-unit=% --duplicate-packet-failure=retry-to-fail \
--negative-packet-loss=retry-to-fail  --one-shot=1 --use-src-ip-flows=1 --use-dst-ip-flows=1 \
--use-src-mac-flows=1 --use-dst-mac-flows=1 --sniff-runtime=10 --warmup-trial --warmup-trial-runtime=10 \
--send-teaching-measurement --send-teaching-warmup --teaching-warmup-packet-type=generic \
--teaching-warmup-packet-rate=10000 --teaching-measurement-packet-type=generic --use-device-stats"

pkill -9 dpdk-testpmd

echo 0 > /sys/bus/pci/devices/0000:5e:00.0/sriov_numvfs
echo 0 > /sys/bus/pci/devices/0000:5e:00.1/sriov_numvfs

Actual results:
From step3, vf test with mtu 9000 failed. If the first pf test didn't add --max-pkt-len=9120 --mbuf-size=9728 to start testpmd.

Expected results:
The first startups of dpdk-testpmd should not affect the second

Additional info:
[   74.212339] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[   74.227295] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[   74.238077] i40e 0000:5e:00.0: FW LLDP is disabled
[   74.242879] i40e 0000:5e:00.0: Allocating 1 VFs.
[   74.352891] pci 0000:5e:02.0: [8086:154c] type 00 class 0x020000
[   74.358911] pci 0000:5e:02.0: enabling Extended Tags
[   74.364111] pci 0000:5e:02.0: Adding to iommu group 135
[   74.405827] iavf: Intel(R) Ethernet Adaptive Virtual Function Network Driver
[   74.412875] Copyright (c) 2013 - 2018 Intel Corporation.
[   74.418286] iavf 0000:5e:02.0: enabling device (0000 -> 0002)
[   74.474263] VFIO - User Level meta-driver version: 0.3
[   74.525139] iavf 0000:5e:02.0: Invalid MAC address 00:00:00:00:00:00, using random
[   74.573093] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[   74.588038] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[   74.598817] i40e 0000:5e:00.1: FW LLDP is disabled
[   74.603618] i40e 0000:5e:00.1: Allocating 1 VFs.
[   74.603763] iavf 0000:5e:02.0: Multiqueue Enabled: Queue pair count = 4
[   74.615674] iavf 0000:5e:02.0: MAC address: 52:a8:4c:6a:34:93
[   74.621433] iavf 0000:5e:02.0: GRO is enabled
[   74.637213] iavf 0000:5e:02.0: Removing device
[   74.712902] pci 0000:5e:0a.0: [8086:154c] type 00 class 0x020000
[   74.718923] pci 0000:5e:0a.0: enabling Extended Tags
[   74.724133] pci 0000:5e:0a.0: Adding to iommu group 136
[   74.729492] iavf 0000:5e:0a.0: enabling device (0000 -> 0002)
[   74.781912] iavf 0000:5e:0a.0: Device is still in reset (-16), retrying
[   74.788556] iavf 0000:5e:0a.0: Removing device
[   74.828824] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[   74.834187] i40e 0000:5e:00.0: VF 0 still in reset. Try again.
[   74.841358] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[   74.846742] i40e 0000:5e:00.0: VF 0 is now trusted
[   74.853606] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[   74.859001] i40e 0000:5e:00.1: VF 0 still in reset. Try again.
[   74.866120] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[   74.871491] i40e 0000:5e:00.1: VF 0 is now trusted
[   77.983116] vfio-pci 0000:5e:02.0: enabling device (0000 -> 0002)
[   78.266396] vfio-pci 0000:5e:0a.0: enabling device (0000 -> 0002)
[   79.884751] i40e 0000:5e:00.0: VF 0 successfully set unicast promiscuous mode
[   79.917475] i40e 0000:5e:00.1: VF 0 successfully set unicast promiscuous mode
[  121.053415] vfio-pci 0000:5e:02.0: Relaying device request to user (#0)
[  121.162249] pci 0000:5e:02.0: Removing from iommu group 135
[  122.303296] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  122.318237] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  122.329058] i40e 0000:5e:00.0: FW LLDP is disabled
[  122.334769] pci 0000:5e:0a.0: Removing from iommu group 136
[  123.517819] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  123.532761] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  123.543497] i40e 0000:5e:00.1: FW LLDP is disabled
[  238.079494] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  238.094466] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  238.105460] i40e 0000:5e:00.0: FW LLDP is disabled
[  238.110256] i40e 0000:5e:00.0: Allocating 1 VFs.
[  238.219454] pci 0000:5e:02.0: [8086:154c] type 00 class 0x020000
[  238.225476] pci 0000:5e:02.0: enabling Extended Tags
[  238.230677] pci 0000:5e:02.0: Adding to iommu group 135
[  238.236084] iavf 0000:5e:02.0: enabling device (0000 -> 0002)
[  238.287152] iavf 0000:5e:02.0: Device is still in reset (-16), retrying
[  238.449994] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  238.464934] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  238.475838] i40e 0000:5e:00.1: FW LLDP is disabled
[  238.480633] i40e 0000:5e:00.1: Allocating 1 VFs.
[  238.587445] pci 0000:5e:0a.0: [8086:154c] type 00 class 0x020000
[  238.593472] pci 0000:5e:0a.0: enabling Extended Tags
[  238.598659] pci 0000:5e:0a.0: Adding to iommu group 136
[  238.604949] iavf 0000:5e:0a.0: enabling device (0000 -> 0002)
[  238.655639] iavf 0000:5e:0a.0: Device is still in reset (-16), retrying
[  238.797200] i40e 0000:5e:00.0: VF 0 is now trusted
[  238.898249] i40e 0000:5e:00.1: VF 0 is now trusted
[  239.439436] iavf 0000:5e:02.0: Invalid MAC address 00:00:00:00:00:00, using random
[  239.447155] iavf 0000:5e:02.0: Multiqueue Enabled: Queue pair count = 4
[  239.454303] iavf 0000:5e:02.0: MAC address: 9a:78:9e:21:36:31
[  239.460063] iavf 0000:5e:02.0: GRO is enabled
[  239.474037] iavf 0000:5e:02.0: Removing device
[  239.823443] iavf 0000:5e:0a.0: Invalid MAC address 00:00:00:00:00:00, using random
[  239.831172] iavf 0000:5e:0a.0: Multiqueue Enabled: Queue pair count = 4
[  239.838878] iavf 0000:5e:0a.0: MAC address: e2:94:a9:4c:16:7b
[  239.844642] iavf 0000:5e:0a.0: GRO is enabled
[  239.858524] iavf 0000:5e:0a.0: Removing device
[  242.157290] vfio-pci 0000:5e:02.0: enabling device (0000 -> 0002)
[  242.424794] vfio-pci 0000:5e:0a.0: enabling device (0000 -> 0002)
[  243.897674] i40e 0000:5e:00.0: VF 0 successfully set unicast promiscuous mode
[  243.926060] i40e 0000:5e:00.1: VF 0 successfully set unicast promiscuous mode
[  341.060749] vfio-pci 0000:5e:02.0: Relaying device request to user (#0)
[  341.173207] pci 0000:5e:02.0: Removing from iommu group 135
[  342.337643] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  342.352596] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  342.363391] i40e 0000:5e:00.0: FW LLDP is disabled
[  342.368623] pci 0000:5e:0a.0: Removing from iommu group 136
[  343.565346] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  343.580292] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  343.592190] i40e 0000:5e:00.1: FW LLDP is disabled
[  406.662409] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  406.677358] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  406.688154] i40e 0000:5e:00.0: FW LLDP is disabled
[  406.692953] i40e 0000:5e:00.0: Allocating 1 VFs.
[  406.805798] pci 0000:5e:02.0: [8086:154c] type 00 class 0x020000
[  406.811822] pci 0000:5e:02.0: enabling Extended Tags
[  406.817015] pci 0000:5e:02.0: Adding to iommu group 135
[  406.822328] iavf 0000:5e:02.0: enabling device (0000 -> 0002)
[  406.873303] iavf 0000:5e:02.0: Device is still in reset (-16), retrying
[  407.056704] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  407.071649] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  407.105727] i40e 0000:5e:00.1: FW LLDP is disabled
[  407.110527] i40e 0000:5e:00.1: Allocating 1 VFs.
[  407.221799] pci 0000:5e:0a.0: [8086:154c] type 00 class 0x020000
[  407.227822] pci 0000:5e:0a.0: enabling Extended Tags
[  407.232984] pci 0000:5e:0a.0: Adding to iommu group 136
[  407.238293] iavf 0000:5e:0a.0: enabling device (0000 -> 0002)
[  407.290090] iavf 0000:5e:0a.0: Device is still in reset (-16), retrying
[  407.430541] i40e 0000:5e:00.0: VF 0 is now trusted
[  407.531539] i40e 0000:5e:00.1: VF 0 is now trusted
[  408.017787] iavf 0000:5e:02.0: Invalid MAC address 00:00:00:00:00:00, using random
[  408.025474] iavf 0000:5e:02.0: Multiqueue Enabled: Queue pair count = 4
[  408.032597] iavf 0000:5e:02.0: MAC address: aa:9a:84:09:c4:a5
[  408.038358] iavf 0000:5e:02.0: GRO is enabled
[  408.043223] iavf 0000:5e:02.0 ens2f0v0: renamed from eth0
[  408.124980] iavf 0000:5e:02.0 ens2f0v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  408.132651] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0v0: link becomes ready
[  408.401794] iavf 0000:5e:0a.0: Invalid MAC address 00:00:00:00:00:00, using random
[  408.409503] iavf 0000:5e:0a.0: Multiqueue Enabled: Queue pair count = 4
[  408.416705] iavf 0000:5e:0a.0: MAC address: fa:fc:72:b9:5a:ab
[  408.422464] iavf 0000:5e:0a.0: GRO is enabled
[  408.427475] iavf 0000:5e:0a.0 ens2f1v0: renamed from eth0
[  408.508987] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f1v0: link becomes ready
[  408.515623] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  410.541983] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[  410.547339] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[  410.554010] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[  410.559370] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[  410.701952] iavf 0000:5e:02.0: Removing device
[  410.798085] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  410.877867] iavf 0000:5e:0a.0: Removing device
[  413.168230] vfio-pci 0000:5e:02.0: enabling device (0000 -> 0002)
[  413.435207] vfio-pci 0000:5e:0a.0: enabling device (0000 -> 0002)
[  414.928262] i40e 0000:5e:00.0: VF 0 successfully set unicast promiscuous mode
[  414.986143] i40e 0000:5e:00.1: VF 0 successfully set unicast promiscuous mode
[  456.238901] vfio-pci 0000:5e:02.0: Relaying device request to user (#0)
[  456.353462] pci 0000:5e:02.0: Removing from iommu group 135
[  457.539223] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  457.554169] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  457.564973] i40e 0000:5e:00.0: FW LLDP is disabled
[  457.570197] pci 0000:5e:0a.0: Removing from iommu group 136
[  458.754991] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  458.769981] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  458.780737] i40e 0000:5e:00.1: FW LLDP is disabled
[  508.032800] i40e 0000:5e:00.0: i40e_ptp_stop: removed PHC on ens2f0
[  508.496718] i40e 0000:5e:00.1: i40e_ptp_stop: removed PHC on ens2f1
[  509.607847] vfio-pci 0000:5e:00.0: Masking broken INTx support
[  509.613756] vfio-pci 0000:5e:00.0: vfio_ecap_init: hiding ecap 0x19@0x1d0
[  509.903367] vfio-pci 0000:5e:00.1: Masking broken INTx support
[  534.618199] i40e 0000:5e:00.0: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[  534.866006] i40e 0000:5e:00.0: MAC address: 40:a6:b7:0e:d0:90
[  534.872044] i40e 0000:5e:00.0: FW LLDP is disabled
[  534.876908] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  534.892324] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  534.904051] i40e 0000:5e:00.0 eth0: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autonege
[  534.905113] i40e 0000:5e:00.0 ens2f0: renamed from eth0
[  534.928969] i40e 0000:5e:00.0: PCI-Express: Speed 8.0GT/s Width x8
[  534.935825] i40e 0000:5e:00.0: Features: PF-id[0] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[  535.015191] i40e 0000:5e:00.1: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[  535.263237] i40e 0000:5e:00.1: MAC address: 40:a6:b7:0e:d0:91
[  535.269279] i40e 0000:5e:00.1: FW LLDP is disabled
[  535.274144] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  535.289613] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  535.301422] i40e 0000:5e:00.1 eth0: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autonege
[  535.301904] i40e 0000:5e:00.1 ens2f1: renamed from eth0
[  535.326183] i40e 0000:5e:00.1: PCI-Express: Speed 8.0GT/s Width x8
[  535.333644] i40e 0000:5e:00.1: Features: PF-id[1] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[  535.951647] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[  538.594739] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  538.609681] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  538.624615] i40e 0000:5e:00.0: FW LLDP is disabled
[  538.629412] i40e 0000:5e:00.0: Allocating 1 VFs.
[  538.735694] pci 0000:5e:02.0: [8086:154c] type 00 class 0x020000
[  538.741720] pci 0000:5e:02.0: enabling Extended Tags
[  538.746931] pci 0000:5e:02.0: Adding to iommu group 135
[  538.754505] iavf 0000:5e:02.0: enabling device (0000 -> 0002)
[  538.806366] iavf 0000:5e:02.0: Device is still in reset (-16), retrying
[  538.968462] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  538.983411] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  538.998503] i40e 0000:5e:00.1: FW LLDP is disabled
[  539.003301] i40e 0000:5e:00.1: Allocating 1 VFs.
[  539.111706] pci 0000:5e:0a.0: [8086:154c] type 00 class 0x020000
[  539.117730] pci 0000:5e:0a.0: enabling Extended Tags
[  539.122922] pci 0000:5e:0a.0: Adding to iommu group 136
[  539.128242] iavf 0000:5e:0a.0: enabling device (0000 -> 0002)
[  539.178631] iavf 0000:5e:0a.0: Device is still in reset (-16), retrying
[  539.321428] i40e 0000:5e:00.0: VF 0 is now trusted
[  539.422452] i40e 0000:5e:00.1: VF 0 is now trusted
[  539.923687] iavf 0000:5e:02.0: Invalid MAC address 00:00:00:00:00:00, using random
[  539.931385] iavf 0000:5e:02.0: Multiqueue Enabled: Queue pair count = 4
[  539.938316] iavf 0000:5e:02.0: MAC address: 32:4a:7e:f9:0e:db
[  539.944073] iavf 0000:5e:02.0: GRO is enabled
[  539.948808] iavf 0000:5e:02.0 ens2f0v0: renamed from eth0
[  540.028870] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0v0: link becomes ready
[  540.030695] iavf 0000:5e:02.0 ens2f0v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  540.307696] iavf 0000:5e:0a.0: Invalid MAC address 00:00:00:00:00:00, using random
[  540.315380] iavf 0000:5e:0a.0: Multiqueue Enabled: Queue pair count = 4
[  540.322229] iavf 0000:5e:0a.0: MAC address: 46:cc:47:ab:90:e2
[  540.327986] iavf 0000:5e:0a.0: GRO is enabled
[  540.332697] iavf 0000:5e:0a.0 ens2f1v0: renamed from eth0
[  540.412878] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  540.420549] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f1v0: link becomes ready
[  542.432094] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[  542.437446] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[  542.443918] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[  542.449294] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[  542.586764] iavf 0000:5e:02.0: Removing device
[  542.683153] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  542.760030] iavf 0000:5e:0a.0: Removing device
[  545.056957] vfio-pci 0000:5e:02.0: enabling device (0000 -> 0002)
[  545.325293] vfio-pci 0000:5e:0a.0: enabling device (0000 -> 0002)
[  546.818157] i40e 0000:5e:00.0: VF 0 successfully set unicast promiscuous mode
[  546.826647] i40e 0000:5e:00.1: VF 0 successfully set unicast promiscuous mode
[  588.116362] vfio-pci 0000:5e:02.0: Relaying device request to user (#0)
[  588.224721] pci 0000:5e:02.0: Removing from iommu group 135
[  589.387244] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  589.402217] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  589.417143] i40e 0000:5e:00.0: FW LLDP is disabled
[  589.422416] pci 0000:5e:0a.0: Removing from iommu group 136
[  590.603282] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  590.618239] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  590.633047] i40e 0000:5e:00.1: FW LLDP is disabled
[  707.110184] i40e 0000:5e:00.0: i40e_ptp_stop: removed PHC on ens2f0
[  707.534929] i40e 0000:5e:00.1: i40e_ptp_stop: removed PHC on ens2f1
[  708.666650] vfio-pci 0000:5e:00.0: Masking broken INTx support
[  708.672552] vfio-pci 0000:5e:00.0: vfio_ecap_init: hiding ecap 0x19@0x1d0
[  708.962189] vfio-pci 0000:5e:00.1: Masking broken INTx support
[  733.670371] i40e 0000:5e:00.0: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[  733.918138] i40e 0000:5e:00.0: MAC address: 40:a6:b7:0e:d0:90
[  733.924184] i40e 0000:5e:00.0: FW LLDP is disabled
[  733.929049] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  733.944465] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  733.956596] i40e 0000:5e:00.0 eth0: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autonege
[  733.957091] i40e 0000:5e:00.0 ens2f0: renamed from eth0
[  733.981012] i40e 0000:5e:00.0: PCI-Express: Speed 8.0GT/s Width x8
[  733.991629] i40e 0000:5e:00.0: Features: PF-id[0] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[  734.069010] i40e 0000:5e:00.1: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[  734.316756] i40e 0000:5e:00.1: MAC address: 40:a6:b7:0e:d0:91
[  734.322794] i40e 0000:5e:00.1: FW LLDP is disabled
[  734.327653] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  734.345482] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  734.357373] i40e 0000:5e:00.1 ens2f1: renamed from eth0
[  734.357858] i40e 0000:5e:00.1 ens2f1: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autone
[  734.378026] i40e 0000:5e:00.1: PCI-Express: Speed 8.0GT/s Width x8
[  734.385592] i40e 0000:5e:00.1: Features: PF-id[1] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[  734.994456] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[  737.772229] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  737.787168] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  737.801733] i40e 0000:5e:00.0: FW LLDP is disabled
[  737.806527] i40e 0000:5e:00.0: Allocating 1 VFs.
[  737.914510] pci 0000:5e:02.0: [8086:154c] type 00 class 0x020000
[  737.920534] pci 0000:5e:02.0: enabling Extended Tags
[  737.925740] pci 0000:5e:02.0: Adding to iommu group 135
[  737.931065] iavf 0000:5e:02.0: enabling device (0000 -> 0002)
[  737.984754] iavf 0000:5e:02.0: Device is still in reset (-16), retrying
[  738.150964] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  738.165900] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  738.180466] i40e 0000:5e:00.1: FW LLDP is disabled
[  738.185260] i40e 0000:5e:00.1: Allocating 1 VFs.
[  738.298509] pci 0000:5e:0a.0: [8086:154c] type 00 class 0x020000
[  738.304537] pci 0000:5e:0a.0: enabling Extended Tags
[  738.309720] pci 0000:5e:0a.0: Adding to iommu group 136
[  738.315031] iavf 0000:5e:0a.0: enabling device (0000 -> 0002)
[  738.365686] iavf 0000:5e:0a.0: Device is still in reset (-16), retrying
[  738.507238] i40e 0000:5e:00.0: VF 0 is now trusted
[  738.608237] i40e 0000:5e:00.1: VF 0 is now trusted
[  738.613106] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[  739.094750] iavf 0000:5e:02.0: Invalid MAC address 00:00:00:00:00:00, using random
[  739.102443] iavf 0000:5e:02.0: Multiqueue Enabled: Queue pair count = 4
[  739.109377] iavf 0000:5e:02.0: MAC address: 12:e4:66:34:05:72
[  739.115133] iavf 0000:5e:02.0: GRO is enabled
[  739.120015] iavf 0000:5e:02.0 ens2f0v0: renamed from eth0
[  739.204685] iavf 0000:5e:02.0 ens2f0v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  739.212350] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0v0: link becomes ready
[  739.478510] iavf 0000:5e:0a.0: Invalid MAC address 00:00:00:00:00:00, using random
[  739.486228] iavf 0000:5e:0a.0: Multiqueue Enabled: Queue pair count = 4
[  739.493088] iavf 0000:5e:0a.0: MAC address: 92:f1:3c:5d:1a:b7
[  739.498845] iavf 0000:5e:0a.0: GRO is enabled
[  739.503661] iavf 0000:5e:0a.0 ens2f1v0: renamed from eth0
[  739.586745] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  739.594412] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f1v0: link becomes ready
[  741.618303] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[  741.623664] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[  741.630321] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[  741.635684] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[  741.774586] iavf 0000:5e:02.0: Removing device
[  741.873068] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  741.944596] iavf 0000:5e:0a.0: Removing device
[  744.239615] vfio-pci 0000:5e:02.0: enabling device (0000 -> 0002)
[  744.511906] vfio-pci 0000:5e:0a.0: enabling device (0000 -> 0002)
[  745.984879] i40e 0000:5e:00.0: VF 0 successfully set unicast promiscuous mode
[  746.013267] i40e 0000:5e:00.1: VF 0 successfully set unicast promiscuous mode
[  761.439461] vfio-pci 0000:5e:02.0: Relaying device request to user (#0)
[  761.447944] vfio-pci 0000:5e:02.0: Device is currently in use, task "sh" (2904) blocked until device is released
[  761.555189] pci 0000:5e:02.0: Removing from iommu group 135
[  762.700961] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  762.715906] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  762.730803] i40e 0000:5e:00.0: FW LLDP is disabled
[  774.177094] pci 0000:5e:0a.0: Removing from iommu group 136
[  775.308478] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  775.323424] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  775.337886] i40e 0000:5e:00.1: FW LLDP is disabled
[  894.797401] i40e 0000:5e:00.0: i40e_ptp_stop: removed PHC on ens2f0
[  895.226505] i40e 0000:5e:00.1: i40e_ptp_stop: removed PHC on ens2f1
[  896.381305] vfio-pci 0000:5e:00.0: Masking broken INTx support
[  896.387210] vfio-pci 0000:5e:00.0: vfio_ecap_init: hiding ecap 0x19@0x1d0
[  896.684840] vfio-pci 0000:5e:00.1: Masking broken INTx support
[  921.383682] i40e 0000:5e:00.0: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[  921.631848] i40e 0000:5e:00.0: MAC address: 40:a6:b7:0e:d0:90
[  921.637892] i40e 0000:5e:00.0: FW LLDP is disabled
[  921.642751] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  921.658233] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  921.670655] i40e 0000:5e:00.0 eth0: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autonege
[  921.671376] i40e 0000:5e:00.0 ens2f0: renamed from eth0
[  921.699393] i40e 0000:5e:00.0: PCI-Express: Speed 8.0GT/s Width x8
[  921.706111] i40e 0000:5e:00.0: Features: PF-id[0] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[  921.784661] i40e 0000:5e:00.1: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[  922.032383] i40e 0000:5e:00.1: MAC address: 40:a6:b7:0e:d0:91
[  922.038423] i40e 0000:5e:00.1: FW LLDP is disabled
[  922.043288] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  922.058691] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  922.070771] i40e 0000:5e:00.1 eth0: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autonege
[  922.070792] i40e 0000:5e:00.1 ens2f1: renamed from eth0
[  922.096245] i40e 0000:5e:00.1: PCI-Express: Speed 8.0GT/s Width x8
[  922.107860] i40e 0000:5e:00.1: Features: PF-id[1] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[  922.709111] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[  925.507255] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  925.522199] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  925.536829] i40e 0000:5e:00.0: FW LLDP is disabled
[  925.541629] i40e 0000:5e:00.0: Allocating 1 VFs.
[  925.653165] pci 0000:5e:02.0: [8086:154c] type 00 class 0x020000
[  925.659190] pci 0000:5e:02.0: enabling Extended Tags
[  925.664422] pci 0000:5e:02.0: Adding to iommu group 135
[  925.671059] iavf 0000:5e:02.0: enabling device (0000 -> 0002)
[  925.725095] iavf 0000:5e:02.0: Device is still in reset (-16), retrying
[  925.890533] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  925.905481] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  925.920190] i40e 0000:5e:00.1: FW LLDP is disabled
[  925.924990] i40e 0000:5e:00.1: Allocating 1 VFs.
[  926.037165] pci 0000:5e:0a.0: [8086:154c] type 00 class 0x020000
[  926.043191] pci 0000:5e:0a.0: enabling Extended Tags
[  926.048379] pci 0000:5e:0a.0: Adding to iommu group 136
[  926.053840] iavf 0000:5e:0a.0: enabling device (0000 -> 0002)
[  926.104539] iavf 0000:5e:0a.0: Device is still in reset (-16), retrying
[  926.170955] i40e 0000:5e:00.0: Reset VF 0 never finished
[  926.269982] i40e 0000:5e:00.0: VF 0 is now trusted
[  926.274852] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[  926.302756] i40e 0000:5e:00.1: Reset VF 0 never finished
[  926.400907] i40e 0000:5e:00.1: VF 0 is now trusted
[  926.873160] iavf 0000:5e:02.0: Invalid MAC address 00:00:00:00:00:00, using random
[  926.880872] iavf 0000:5e:02.0: Multiqueue Enabled: Queue pair count = 4
[  926.887813] iavf 0000:5e:02.0: MAC address: b6:90:4e:31:9a:47
[  926.893569] iavf 0000:5e:02.0: GRO is enabled
[  926.898995] iavf 0000:5e:02.0 ens2f0v0: renamed from eth0
[  926.959340] iavf 0000:5e:02.0 ens2f0v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  926.967009] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0v0: link becomes ready
[  927.257163] iavf 0000:5e:0a.0: Invalid MAC address 00:00:00:00:00:00, using random
[  927.264858] iavf 0000:5e:0a.0: Multiqueue Enabled: Queue pair count = 4
[  927.271770] iavf 0000:5e:0a.0: MAC address: c6:60:a0:b7:22:d4
[  927.277522] iavf 0000:5e:0a.0: GRO is enabled
[  927.282218] iavf 0000:5e:0a.0 ens2f1v0: renamed from eth0
[  927.367345] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f1v0: link becomes ready
[  927.368168] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  929.410456] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[  929.415830] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[  929.422403] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[  929.427779] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[  929.571235] iavf 0000:5e:02.0: Removing device
[  929.667461] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[  929.745495] iavf 0000:5e:0a.0: Removing device
[  932.037716] vfio-pci 0000:5e:02.0: enabling device (0000 -> 0002)
[  932.306572] vfio-pci 0000:5e:0a.0: enabling device (0000 -> 0002)
[  933.779678] i40e 0000:5e:00.0: VF 0 successfully set unicast promiscuous mode
[  933.807013] i40e 0000:5e:00.1: VF 0 successfully set unicast promiscuous mode
[  975.110509] vfio-pci 0000:5e:02.0: Relaying device request to user (#0)
[  975.222181] pci 0000:5e:02.0: Removing from iommu group 135
[  976.400626] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[  976.415612] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[  976.430330] i40e 0000:5e:00.0: FW LLDP is disabled
[  976.435575] pci 0000:5e:0a.0: Removing from iommu group 136
[  977.615103] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[  977.630050] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[  977.644589] i40e 0000:5e:00.1: FW LLDP is disabled
[ 1123.561083] i40e 0000:5e:00.0: i40e_ptp_stop: removed PHC on ens2f0
[ 1124.015561] i40e 0000:5e:00.1: i40e_ptp_stop: removed PHC on ens2f1
[ 1125.136586] vfio-pci 0000:5e:00.0: Masking broken INTx support
[ 1125.142500] vfio-pci 0000:5e:00.0: vfio_ecap_init: hiding ecap 0x19@0x1d0
[ 1125.432102] vfio-pci 0000:5e:00.1: Masking broken INTx support
[ 1150.140892] i40e 0000:5e:00.0: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[ 1150.388635] i40e 0000:5e:00.0: MAC address: 40:a6:b7:0e:d0:90
[ 1150.394675] i40e 0000:5e:00.0: FW LLDP is disabled
[ 1150.399537] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[ 1150.414950] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[ 1150.428546] i40e 0000:5e:00.0 ens2f0: renamed from eth0
[ 1150.435492] i40e 0000:5e:00.0 ens2f0: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autone
[ 1150.451882] i40e 0000:5e:00.0: PCI-Express: Speed 8.0GT/s Width x8
[ 1150.462364] i40e 0000:5e:00.0: Features: PF-id[0] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 1150.541932] i40e 0000:5e:00.1: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[ 1150.789626] i40e 0000:5e:00.1: MAC address: 40:a6:b7:0e:d0:91
[ 1150.795666] i40e 0000:5e:00.1: FW LLDP is disabled
[ 1150.800527] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[ 1150.815944] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[ 1150.827691] i40e 0000:5e:00.1 ens2f1: renamed from eth0
[ 1150.827958] i40e 0000:5e:00.1 ens2f1: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autone
[ 1150.849694] i40e 0000:5e:00.1: PCI-Express: Speed 8.0GT/s Width x8
[ 1150.861408] i40e 0000:5e:00.1: Features: PF-id[1] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 1151.448378] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[ 1154.250264] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[ 1154.265234] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[ 1154.280216] i40e 0000:5e:00.0: FW LLDP is disabled
[ 1154.285022] i40e 0000:5e:00.0: Allocating 1 VFs.
[ 1154.392441] pci 0000:5e:02.0: [8086:154c] type 00 class 0x020000
[ 1154.398464] pci 0000:5e:02.0: enabling Extended Tags
[ 1154.403672] pci 0000:5e:02.0: Adding to iommu group 135
[ 1154.408983] iavf 0000:5e:02.0: enabling device (0000 -> 0002)
[ 1154.459741] iavf 0000:5e:02.0: Device is still in reset (-16), retrying
[ 1154.629176] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[ 1154.644109] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[ 1154.658851] i40e 0000:5e:00.1: FW LLDP is disabled
[ 1154.663646] i40e 0000:5e:00.1: Allocating 1 VFs.
[ 1154.776446] pci 0000:5e:0a.0: [8086:154c] type 00 class 0x020000
[ 1154.782471] pci 0000:5e:0a.0: enabling Extended Tags
[ 1154.787642] pci 0000:5e:0a.0: Adding to iommu group 136
[ 1154.792961] iavf 0000:5e:0a.0: enabling device (0000 -> 0002)
[ 1154.843323] iavf 0000:5e:0a.0: Device is still in reset (-16), retrying
[ 1154.986188] i40e 0000:5e:00.0: VF 0 is now trusted
[ 1154.991059] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[ 1155.092187] i40e 0000:5e:00.1: VF 0 is now trusted
[ 1155.612425] iavf 0000:5e:02.0: Invalid MAC address 00:00:00:00:00:00, using random
[ 1155.620109] iavf 0000:5e:02.0: Multiqueue Enabled: Queue pair count = 4
[ 1155.626981] iavf 0000:5e:02.0: MAC address: fa:11:55:28:3b:db
[ 1155.632733] iavf 0000:5e:02.0: GRO is enabled
[ 1155.637493] iavf 0000:5e:02.0 ens2f0v0: renamed from eth0
[ 1155.717616] iavf 0000:5e:02.0 ens2f0v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[ 1155.725283] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0v0: link becomes ready
[ 1155.996432] iavf 0000:5e:0a.0: Invalid MAC address 00:00:00:00:00:00, using random
[ 1156.004136] iavf 0000:5e:0a.0: Multiqueue Enabled: Queue pair count = 4
[ 1156.010978] iavf 0000:5e:0a.0: MAC address: aa:38:0d:bf:1e:08
[ 1156.016739] iavf 0000:5e:0a.0: GRO is enabled
[ 1156.021630] iavf 0000:5e:0a.0 ens2f1v0: renamed from eth0
[ 1156.109622] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[ 1156.117294] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f1v0: link becomes ready
[ 1158.102317] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[ 1158.107683] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[ 1158.114361] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[ 1158.119729] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[ 1158.266734] iavf 0000:5e:02.0: Removing device
[ 1158.315642] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[ 1158.445535] iavf 0000:5e:0a.0: Removing device
[ 1160.749539] vfio-pci 0000:5e:02.0: enabling device (0000 -> 0002)
[ 1161.021823] vfio-pci 0000:5e:0a.0: enabling device (0000 -> 0002)
[ 1162.494707] i40e 0000:5e:00.0: VF 0 successfully set unicast promiscuous mode
[ 1162.523143] i40e 0000:5e:00.1: VF 0 successfully set unicast promiscuous mode
[ 1203.816905] vfio-pci 0000:5e:02.0: Relaying device request to user (#0)
[ 1203.929459] pci 0000:5e:02.0: Removing from iommu group 135
[ 1205.076278] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[ 1205.091253] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[ 1205.106115] i40e 0000:5e:00.0: FW LLDP is disabled
[ 1205.111371] pci 0000:5e:0a.0: Removing from iommu group 136
[ 1206.291955] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[ 1206.306911] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[ 1206.321724] i40e 0000:5e:00.1: FW LLDP is disabled
[ 1809.926954] i40e 0000:5e:00.0: i40e_ptp_stop: removed PHC on ens2f0
[ 1810.352970] i40e 0000:5e:00.1: i40e_ptp_stop: removed PHC on ens2f1
[ 1811.506426] vfio-pci 0000:5e:00.0: Masking broken INTx support
[ 1811.512331] vfio-pci 0000:5e:00.0: vfio_ecap_init: hiding ecap 0x19@0x1d0
[ 1811.809953] vfio-pci 0000:5e:00.1: Masking broken INTx support
[ 1836.560849] i40e 0000:5e:00.0: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[ 1836.808860] i40e 0000:5e:00.0: MAC address: 40:a6:b7:0e:d0:90
[ 1836.814900] i40e 0000:5e:00.0: FW LLDP is disabled
[ 1836.819762] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[ 1836.835181] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[ 1836.847216] i40e 0000:5e:00.0 eth0: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autonege
[ 1836.848519] i40e 0000:5e:00.0 ens2f0: renamed from eth0
[ 1836.871768] i40e 0000:5e:00.0: PCI-Express: Speed 8.0GT/s Width x8
[ 1836.882227] i40e 0000:5e:00.0: Features: PF-id[0] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 1836.963354] i40e 0000:5e:00.1: fw 9.820.73026 api 1.15 nvm 9.20 0x8000d960 22.0.9 [8086:158b] [8086:0009]
[ 1837.211218] i40e 0000:5e:00.1: MAC address: 40:a6:b7:0e:d0:91
[ 1837.217254] i40e 0000:5e:00.1: FW LLDP is disabled
[ 1837.222118] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[ 1837.237525] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[ 1837.248890] i40e 0000:5e:00.1 eth0: NIC Link is Up, 25 Gbps Full Duplex, Requested FEC: CL108 RS-FEC, Negotiated FEC: CL108 RS-FEC, Autonege
[ 1837.249569] i40e 0000:5e:00.1 ens2f1: renamed from eth0
[ 1837.274515] i40e 0000:5e:00.1: PCI-Express: Speed 8.0GT/s Width x8
[ 1837.289902] i40e 0000:5e:00.1: Features: PF-id[1] VFs: 64 VSIs: 66 QP: 48 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 1837.858244] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[ 1840.674036] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[ 1840.688990] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[ 1840.703244] i40e 0000:5e:00.0: FW LLDP is disabled
[ 1840.708039] i40e 0000:5e:00.0: Allocating 1 VFs.
[ 1840.818298] pci 0000:5e:02.0: [8086:154c] type 00 class 0x020000
[ 1840.824319] pci 0000:5e:02.0: enabling Extended Tags
[ 1840.829520] pci 0000:5e:02.0: Adding to iommu group 135
[ 1840.834847] iavf 0000:5e:02.0: enabling device (0000 -> 0002)
[ 1840.886238] iavf 0000:5e:02.0: Device is still in reset (-16), retrying
[ 1841.053526] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[ 1841.068464] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[ 1841.083090] i40e 0000:5e:00.1: FW LLDP is disabled
[ 1841.087892] i40e 0000:5e:00.1: Allocating 1 VFs.
[ 1841.194301] pci 0000:5e:0a.0: [8086:154c] type 00 class 0x020000
[ 1841.200320] pci 0000:5e:0a.0: enabling Extended Tags
[ 1841.205509] pci 0000:5e:0a.0: Adding to iommu group 136
[ 1841.210830] iavf 0000:5e:0a.0: enabling device (0000 -> 0002)
[ 1841.261316] iavf 0000:5e:0a.0: Device is still in reset (-16), retrying
[ 1841.403070] i40e 0000:5e:00.0: VF 0 is now trusted
[ 1841.407938] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[ 1841.510078] i40e 0000:5e:00.1: VF 0 is now trusted
[ 1842.022287] iavf 0000:5e:02.0: Invalid MAC address 00:00:00:00:00:00, using random
[ 1842.029976] iavf 0000:5e:02.0: Multiqueue Enabled: Queue pair count = 4
[ 1842.037246] iavf 0000:5e:02.0: MAC address: f2:05:90:16:a7:6d
[ 1842.042999] iavf 0000:5e:02.0: GRO is enabled
[ 1842.048041] iavf 0000:5e:02.0 ens2f0v0: renamed from eth0
[ 1842.129481] iavf 0000:5e:02.0 ens2f0v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[ 1842.137149] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0v0: link becomes ready
[ 1842.406543] iavf 0000:5e:0a.0: Invalid MAC address 00:00:00:00:00:00, using random
[ 1842.414228] iavf 0000:5e:0a.0: Multiqueue Enabled: Queue pair count = 4
[ 1842.421148] iavf 0000:5e:0a.0: MAC address: 7e:44:71:53:68:92
[ 1842.426908] iavf 0000:5e:0a.0: GRO is enabled
[ 1842.431698] iavf 0000:5e:0a.0 ens2f1v0: renamed from eth0
[ 1842.495479] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[ 1842.503149] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f1v0: link becomes ready
[ 1844.519977] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[ 1844.525333] i40e 0000:5e:00.0: VF 0 in reset. Try again.
[ 1844.531879] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[ 1844.537232] i40e 0000:5e:00.1: VF 0 in reset. Try again.
[ 1844.688364] iavf 0000:5e:02.0: Removing device
[ 1844.735516] iavf 0000:5e:0a.0 ens2f1v0: NIC Link is Up Speed is 25 Gbps Full Duplex
[ 1844.860618] iavf 0000:5e:0a.0: Removing device
[ 1847.157356] vfio-pci 0000:5e:02.0: enabling device (0000 -> 0002)
[ 1847.423708] vfio-pci 0000:5e:0a.0: enabling device (0000 -> 0002)
[ 1848.896829] i40e 0000:5e:00.0: VF 0 successfully set unicast promiscuous mode
[ 1848.924103] i40e 0000:5e:00.1: VF 0 successfully set unicast promiscuous mode
[ 1890.226367] vfio-pci 0000:5e:02.0: Relaying device request to user (#0)
[ 1890.339382] pci 0000:5e:02.0: Removing from iommu group 135
[ 1891.484776] i40e 0000:5e:00.0: FW LLDP is disabled, attempting SW DCB
[ 1891.499717] i40e 0000:5e:00.0: SW DCB initialization succeeded.
[ 1891.514293] i40e 0000:5e:00.0: FW LLDP is disabled
[ 1891.519568] pci 0000:5e:0a.0: Removing from iommu group 136
[ 1892.701227] i40e 0000:5e:00.1: FW LLDP is disabled, attempting SW DCB
[ 1892.716206] i40e 0000:5e:00.1: SW DCB initialization succeeded.
[ 1892.730702] i40e 0000:5e:00.1: FW LLDP is disabled

Note You need to log in before you can comment on or make changes to this bug.