Bug 1764916

Summary: DPDK testpmd can not find ethernet ports in GUEST
Product: Red Hat Enterprise Linux 7 Reporter: Hekai Wang <hewang>
Component: dpdkAssignee: Jens Freimann <jfreiman>
Status: CLOSED WONTFIX QA Contact: Hekai Wang <hewang>
Severity: high Docs Contact:
Priority: high    
Version: 7.8CC: aadam, ctrautma, fhallal, jhsiao, kzhang, maxime.coquelin, ovs-qe, qding, sassmann
Target Milestone: pre-dev-freezeKeywords: Extras
Target Release: 7.9   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1834164 (view as bug list) Environment:
Last Closed: 2020-05-11 08:40:53 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1834164    

Description Hekai Wang 2019-10-24 03:38:40 UTC 
Description of problem:
dpdk testpmd app can not find ethernet ports which is already bind to vfio-pci driver in qemu-kvm guest .

Version-Release number of selected component (if applicable):
[root@dell-per730-04 vsperf]# rpm -qa | grep openv
openvswitch-selinux-extra-policy-1.0-13.el7fdp.noarch
openvswitch2.11-2.11.0-26.el7fdp.x86_64
rpm[root@dell-per730-04 vsperf]# rpm -qa | grep qemu
qemu-img-rhev-2.12.0-25.el7.x86_64
qemu-kvm-rhev-2.12.0-25.el7.x86_64
ipxe-roms-qemu-20180825-2.git133f4c.el7.noarch
libvirt-daemon-driver-qemu-4.5.0-26.el7.x86_64
qemu-kvm-common-rhev-2.12.0-25.el7.x86_64
qemu-kvm-tools-rhev-2.12.0-33.el7.x86_64
[root@dell-per730-04 vsperf]# uname -a
Linux dell-per730-04.rhts.eng.pek2.redhat.com 3.10.0-1101.el7.x86_64 #1 SMP Sat Oct 5 04:50:26 EDT 2019 x86_64 x86_64 x86_64 GNU/Linux
[root@dell-per730-04 vsperf]# cat /etc/os-release 
NAME="Red Hat Enterprise Linux Server"
VERSION="7.8 (Maipo)"
ID="rhel"
ID_LIKE="fedora"
VARIANT="Server"
VARIANT_ID="server"
VERSION_ID="7.8"
PRETTY_NAME="Red Hat Enterprise Linux Server 7.8 Beta (Maipo)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:redhat:enterprise_linux:7.8:beta:server"
HOME_URL="https://www.redhat.com/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"

REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7"
REDHAT_BUGZILLA_PRODUCT_VERSION=7.8
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="7.8 Beta"
[root@dell-per730-04 vsperf]# ethtool -i p3p1
driver: i40e
version: 2.8.20-k
firmware-version: 6.80 0x80003d72 18.8.9
expansion-rom-version: 
bus-info: 0000:84:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
[root@dell-per730-04 vsperf]# lspci -s 84:00.0 -vvv
84:00.0 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GbE SFP+ (rev 01)
	Subsystem: Intel Corporation Ethernet 10G 2P X710 Adapter
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 95
	NUMA node: 1
	Region 0: Memory at d6000000 (64-bit, prefetchable) [size=16M]
	Region 3: Memory at d7808000 (64-bit, prefetchable) [size=32K]
	Expansion ROM at dbe00000 [disabled] [size=512K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
		Address: 0000000000000000  Data: 0000
		Masking: 00000000  Pending: 00000000
	Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
		Vector table: BAR=3 offset=00000000
		PBA: BAR=3 offset=00001000
	Capabilities: [a0] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
			RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop- FLReset-
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L0s <2us, L1 <16us
			ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-, LTR-, OBFF Disabled
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [e0] Vital Product Data
		Product Name: X710 10GbE Controller
		Read-only fields:
			[V0] Vendor specific: FFV18.8.9
			[PN] Part number: CGFY6
			[MN] Manufacture ID: 31 30 32 38
			[V1] Vendor specific: DSV1028VPDR.VER2.0
			[V3] Vendor specific: DTINIC
			[V4] Vendor specific: DCM1001FFFFFF2101FFFFFF1202FFFFFF2302FFFFFF1403FFFFFF2503FFFFFF1604FFFFFF2704FFFFFF1805FFFFFF2905FFFFFF1A06FFFFFF2B06FFFFFF1C07FFFFFF2D07FFFFFF1E08FFFFFF2F08FFFFFF
			[V5] Vendor specific: NPY2
			[V6] Vendor specific: PMT7
			[V7] Vendor specific: NMVIntel Corp
			[V8] Vendor specific: L1D0
			[RV] Reserved: checksum good, 1 byte(s) reserved
		Read/write fields:
			[Y1] System specific: CCF1
		End
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn+ ChkCap+ ChkEn+
	Capabilities: [140 v1] Device Serial Number a0-c4-02-ff-ff-1e-f2-f8
	Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
		ARICap:	MFVC- ACS-, Next Function: 1
		ARICtl:	MFVC- ACS-, Function Group: 0
	Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
		IOVCap:	Migration-, Interrupt Message Number: 000
		IOVCtl:	Enable+ Migration- Interrupt- MSE+ ARIHierarchy+
		IOVSta:	Migration-
		Initial VFs: 64, Total VFs: 64, Number of VFs: 1, Function Dependency Link: 00
		VF offset: 16, stride: 1, Device ID: 154c
		Supported Page Size: 00000553, System Page Size: 00000001
		Region 0: Memory at 00000000d7400000 (64-bit, prefetchable)
		Region 3: Memory at 00000000d7910000 (64-bit, prefetchable)
		VF Migration: offset: 00000000, BIR: 0
	Capabilities: [1a0 v1] Transaction Processing Hints
		Device specific mode supported
		No steering table available
	Capabilities: [1b0 v1] Access Control Services
		ACSCap:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [1d0 v1] #19
	Kernel driver in use: i40e
	Kernel modules: i40e

[root@dell-per730-04 vsperf]# 


How reproducible:
Always

Steps to Reproduce:
:: [ 23:15:04 ] :: [  BEGIN   ] :: Running 'virsh dumpxml gg'
<domain type='kvm' id='5'>
  <name>gg</name>
  <uuid>37425e76-af6a-44a6-aba0-73434afe34c0</uuid>
  <memory unit='KiB'>8388608</memory>
  <currentMemory unit='KiB'>8388608</currentMemory>
  <memoryBacking>
    <hugepages>
      <page size='1048576' unit='KiB'/>
    </hugepages>
    <access mode='shared'/>
  </memoryBacking>
  <vcpu placement='static'>3</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='1,25'/>
    <vcpupin vcpu='1' cpuset='3,27'/>
    <vcpupin vcpu='2' cpuset='5,29'/>
  </cputune>
  <numatune>
    <memory mode='strict' nodeset='1'/>
  </numatune>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-q35-rhel7.5.0'>hvm</type>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <pmu state='off'/>
    <vmport state='off'/>
    <ioapic driver='qemu'/>
  </features>
  <cpu mode='host-passthrough' check='none'>
    <feature policy='require' name='tsc-deadline'/>
    <numa>
      <cell id='0' cpus='0-2' memory='8388608' unit='KiB' memAccess='shared'/>
    </numa>
  </cpu>
  <clock offset='utc'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <pm>
    <suspend-to-mem enabled='no'/>
    <suspend-to-disk enabled='no'/>
  </pm>
  <devices>
    <emulator>/usr/libexec/qemu-kvm</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2'/>
      <source file='/root/RHEL_NIC_QUALIFICATION/vsperf/rhel7.6-vsperf-1Q-viommu.qcow2'/>
      <backingStore/>
      <target dev='vda' bus='virtio'/>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </disk>
    <controller type='usb' index='0' model='none'>
      <alias name='usb'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'>
      <alias name='pcie.0'/>
    </controller>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x10'/>
      <alias name='pci.1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </controller>
    <controller type='pci' index='2' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='2' port='0x11'/>
      <alias name='pci.2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </controller>
    <controller type='pci' index='3' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='3' port='0x8'/>
      <alias name='pci.3'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0x9'/>
      <alias name='pci.4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </controller>
    <controller type='pci' index='5' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='5' port='0xa'/>
      <alias name='pci.5'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </controller>
    <controller type='pci' index='6' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='6' port='0xb'/>
      <alias name='pci.6'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
    </controller>
    <controller type='sata' index='0'>
      <alias name='ide'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:bb:63:7b'/>
      <source bridge='virbr0'/>
      <target dev='vnet0'/>
      <model type='virtio'/>
      <alias name='net0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
    </interface>
    <interface type='hostdev' managed='yes'>
      <mac address='52:54:00:11:8f:ea'/>
      <driver name='vfio'/>
      <source>
        <address type='pci' domain='0x0000' bus='0x84' slot='0x02' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
    </interface>
    <interface type='hostdev' managed='yes'>
      <mac address='52:54:00:11:8f:eb'/>
      <driver name='vfio'/>
      <source>
        <address type='pci' domain='0x0000' bus='0x84' slot='0x0a' function='0x0'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
    </interface>
    <serial type='pty'>
      <source path='/dev/pts/4'/>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
      <alias name='serial0'/>
    </serial>
    <console type='pty' tty='/dev/pts/4'>
      <source path='/dev/pts/4'/>
      <target type='serial' port='0'/>
      <alias name='serial0'/>
    </console>
    <input type='mouse' bus='ps2'>
      <alias name='input0'/>
    </input>
    <input type='keyboard' bus='ps2'>
      <alias name='input1'/>
    </input>
    <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
      <listen type='address' address='0.0.0.0'/>
    </graphics>
    <video>
      <model type='cirrus' vram='16384' heads='1' primary='yes'/>
      <alias name='video0'/>
      <address type='pci' domain='0x0000' bus='0x05' slot='0x00' function='0x0'/>
    </video>
    <memballoon model='virtio'>
      <alias name='balloon0'/>
      <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/>
    </memballoon>
    <iommu model='intel'>
      <driver intremap='on' caching_mode='on' iotlb='on'/>
    </iommu>
  </devices>
  <seclabel type='dynamic' model='selinux' relabel='yes'>
    <label>system_u:system_r:svirt_t:s0:c587,c723</label>
    <imagelabel>system_u:object_r:svirt_image_t:s0:c587,c723</imagelabel>
  </seclabel>
  <seclabel type='dynamic' model='dac' relabel='yes'>
    <label>+107:+1001</label>
    <imagelabel>+107:+1001</imagelabel>
  </seclabel>
</domain>

:: [ 23:15:04 ] :: [   PASS   ] :: Command 'virsh dumpxml gg' (Expected 0, got 0)
:: [ 23:15:04 ] :: [  BEGIN   ] :: Running 'echo'

:: [ 23:15:04 ] :: [   PASS   ] :: Command 'echo' (Expected 0, got 0)
:: [ 23:15:04 ] :: [   LOG    ] :: guest start testpmd test Now
:: [ 23:15:14 ] :: [   LOG    ] :: /root/one_gig_hugepages.sh 1
:: [ 23:15:14 ] :: [   LOG    ] :: ++ echo 1
:: [ 23:15:14 ] :: [   LOG    ] :: rpm -ivh /root/dpdkrpms/18112-1/dpdk*.rpm
:: [ 23:15:14 ] :: [   LOG    ] :: error: File not found by glob: /root/dpdkrpms/18112-1/dpdk*.rpm
:: [ 23:15:14 ] :: [   LOG    ] :: rpm -ivh /root//18112-1/dpdk*.rpm
################################# [100%]ring... ( 50%)
:: [ 23:15:14 ] :: [   LOG    ] :: Updating / installing...
################################# [ 50%]dk-18.11.2-1.el7_6 ( 2%)
################################# [100%]dk-tools-18.11.2-1.el7_6 ( 3%)
:: [ 23:15:14 ] :: [enable_unsafe_noiommu_mode=1 > /etc/modp                ] :: echo options
:: [ 23:15:14 ] :: [   LOG    ] :: robe.d/vfio.conf
:: [ 23:15:14 ] :: [   LOG    ] :: modprobe -r vfio_iommu_type1
:: [ 23:15:14 ] :: [   LOG    ] :: modprobe -r vfio-pci
:: [ 23:15:14 ] :: [   LOG    ] :: modprobe -r vfio
:: [ 23:15:14 ] :: [   LOG    ] :: modprobe vfio
:: [ 23:15:14 ] :: [   LOG    ] :: modprobe vfio-pci
:: [ 23:15:14 ] :: [   LOG    ] :: ip link set eth1 down
:: [ 23:15:14 ] :: [   LOG    ] :: ip link set eth2 down
:: [ 23:15:14 ] :: [   LOG    ] :: ip link show
:: [ 23:15:14 ] :: [   LOG    ] :: 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
:: [ 23:15:14 ] :: [   LOG    ] ::  link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
:: [ 23:15:14 ] :: [   LOG    ] :: 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP mode DEFAULT group default qlen 1000
:: [ 23:15:14 ] :: [   LOG    ] ::  link/ether 52:54:00:bb:63:7b brd ff:ff:ff:ff:ff:ff
:: [ 23:15:14 ] :: [   LOG    ] :: 3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
:: [ 23:15:14 ] :: [   LOG    ] ::  link/ether 52:54:00:11:8f:ea brd ff:ff:ff:ff:ff:ff
:: [ 23:15:14 ] :: [   LOG    ] :: 4: eth2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
:: [ 23:15:14 ] :: [   LOG    ] ::  link/ether 52:54:00:11:8f:eb brd ff:ff:ff:ff:ff:ff
:: [ 23:15:14 ] :: [   LOG    ] :: dpdk-devbind -b vfio-pci 0000:03:00.0
:: [ 23:15:14 ] :: [   LOG    ] :: dpdk-devbind -b vfio-pci 0000:04:00.0
:: [ 23:15:14 ] :: [   LOG    ] :: dpdk-devbind --status
:: [ 23:15:14 ] :: [   LOG    ] :: Network devices using DPDK-compatible driver
:: [ 23:15:14 ] :: [   LOG    ] :: ============================================
:: [ 23:15:14 ] :: [   LOG    ] :: 0000:03:00.0 'Ethernet Virtual Function 700 Series 154c' drv=vfio-pci unused=i40evf
:: [ 23:15:14 ] :: [   LOG    ] :: 0000:04:00.0 'Ethernet Virtual Function 700 Series 154c' drv=vfio-pci unused=i40evf
:: [ 23:15:14 ] :: [   LOG    ] :: Network devices using kernel driver
:: [ 23:15:14 ] :: [   LOG    ] :: ===================================
:: [ 23:15:14 ] :: [   LOG    ] :: 0000:02:00.0 'Virtio network device 1041' if=eth0 drv=virtio-pci unused=virtio_pci,vfio-pci 
:: [ 23:15:14 ] :: [   LOG    ] :: No 'Crypto' devices detected
:: [ 23:15:14 ] :: [   LOG    ] :: ============================
:: [ 23:15:14 ] :: [   LOG    ] :: No 'Eventdev' devices detected
:: [ 23:15:14 ] :: [   LOG    ] :: ==============================
:: [ 23:15:14 ] :: [   LOG    ] :: No 'Mempool' devices detected
:: [ 23:15:14 ] :: [   LOG    ] :: =============================
:: [ 23:15:14 ] :: [   LOG    ] :: No 'Compress' devices detected
:: [ 23:15:14 ] :: [   LOG    ] :: ==============================
:: [ 23:15:14 ] :: [   LOG    ] :: 
:: [ 23:15:23 ] :: [   LOG    ] :: testpmd -l 0,1,2 --socket-mem 1024 --legacy-mem 
:: [ 23:15:23 ] :: [   LOG    ] ::  -n 4 -- --forward-mode=mac --port-topology=paired --disa 
:: [ 23:15:23 ] :: [   LOG    ] :: ble-rss -i --rxq=1 --txq=1 --rxd=2048 --txd=2048 --nb-co 
:: [ 23:15:23 ] :: [   LOG    ] :: res=2 --max-pkt-len=64 --eth-peer=0,a0:36:9f:65:ee:7a --eth-peer=1,a0:36 
:: [ 23:15:24 ] :: [   LOG    ] :: :9f:65:ee:78 --auto-start
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Detected 3 lcore(s)
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Detected 1 NUMA nodes
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Some devices want iova as va but pa will be used because.. EAL: vfio-noiommu mode configured
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Probing VFIO support...
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: VFIO support initialized
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using unreliable clock cycles !
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: PCI device 0000:02:00.0 on NUMA socket -1
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Invalid NUMA socket, default to 0
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: probe driver: 1af4:1041 net_virtio
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: PCI device 0000:03:00.0 on NUMA socket -1
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Invalid NUMA socket, default to 0
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: probe driver: 8086:154c net_i40e_vf
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: using IOMMU type 1 (Type 1)
:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_check_api_version(): fail to execute command OP_VERSION
:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_init_vf(): check_api version failed
:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_dev_init(): Init vf failed
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Releasing pci mapped resource for 0000:03:00.0
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Calling pci_unmap_resource for 0000:03:00.0 at 0x940000000
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Calling pci_unmap_resource for 0000:03:00.0 at 0x940010000
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Requested device 0000:03:00.0 cannot be used
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: PCI device 0000:04:00.0 on NUMA socket -1
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Invalid NUMA socket, default to 0
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: probe driver: 8086:154c net_i40e_vf
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: using IOMMU type 1 (Type 1)
:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_check_api_version(): fail to execute command OP_VERSION
:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_init_vf(): check_api version failed
:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_dev_init(): Init vf failed
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Releasing pci mapped resource for 0000:04:00.0
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Calling pci_unmap_resource for 0000:04:00.0 at 0x940014000
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Calling pci_unmap_resource for 0000:04:00.0 at 0x940024000
:: [ 23:15:24 ] :: [   LOG    ] :: EAL: Requested device 0000:04:00.0 cannot be used
:: [ 23:15:24 ] :: [   LOG    ] :: testpmd: No probed ethernet devices
:: [ 23:15:24 ] :: [   LOG    ] :: Set mac packet forwarding mode
:: [ 23:15:24 ] :: [   LOG    ] :: Interactive-mode selected
:: [ 23:15:24 ] :: [   LOG    ] :: Auto-start selected
:: [ 23:15:24 ] :: [   LOG    ] :: testpmd: create a new mbuf pool <mbuf_pool_socket_0>: n=163456, size=2176, socket=0
:: [ 23:15:24 ] :: [   LOG    ] :: testpmd: preferred mempool ops selected: ring_mp_mc
:: [ 23:15:24 ] :: [   LOG    ] :: Done
:: [ 23:15:24 ] :: [   LOG    ] :: Start automatic packet forwarding
:: [ 23:15:24 ] :: [   LOG    ] :: mac packet forwarding - ports=0 - cores=0 - streams=0 - NUMA support enabled, MP allocation mode: native
:: [ 23:15:24 ] :: [   LOG    ] ::  mac packet forwarding packets/burst=32
:: [ 23:15:24 ] :: [   LOG    ] ::  nb forwarding cores=2 - nb forwarding ports=0
:: [ 23:15:24 ] :: [   LOG    ] :: 

Actual results:
there is no avail port in testpmd

Expected results:
testpmd can find the avail port .

Additional info:
Comment 2 Jens Freimann 2019-11-07 10:56:14 UTC 
Stefan, have you seen this before:

:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_check_api_version(): fail to execute command OP_VERSION
:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_init_vf(): check_api version failed
:: [ 23:15:24 ] :: [   LOG    ] :: i40evf_dev_init(): Init vf failed

There's another BZ where they see this (https://bugzilla.redhat.com/show_bug.cgi?id=1494424) and re-tried
with updated firmware, but it didn't resolve the problem. Any idea?
Comment 3 Stefan Assmann 2019-11-07 12:07:30 UTC 
Hi Jens,

afaict those messages are not emitted by the in-kernel driver.
You have to bring this up with the DPDK people.
Comment 7 Jens Freimann 2020-01-09 13:52:02 UTC 
Hi Hekai, could this be a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=1494424?
Could you try what is suggested in https://bugzilla.redhat.com/show_bug.cgi?id=1494424#c20?