Description of problem: I am trying to deploy a setup in which a E810C nic is configured in openvswitch and it openvswitch is failing with the following error: Bridge br-link0 fail_mode: standalone datapath_type: netdev Port br-link0 tag: 171 Interface br-link0 type: internal Port dpdkbond0 Interface dpdk1 type: dpdk options: {dpdk-devargs="0000:3b:00.1", n_rxq="1"} error: "Error attaching device '0000:3b:00.1' to DPDK" Interface dpdk0 type: dpdk options: {dpdk-devargs="0000:3b:00.0", n_rxq="1"} error: "Error attaching device '0000:3b:00.0' to DPDK" 2022-07-05T14:25:12.106Z|00158|dpdk|INFO|EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:3b:00.1 (socket 0) 2022-07-05T14:25:12.308Z|00159|dpdk|WARN|EAL: libarchive not linked, /lib/firmware/intel/ice/ddp/ice.pkg.xz cannot be decompressed 2022-07-05T14:25:12.308Z|00160|dpdk|ERR|ice_load_pkg(): failed to search file path 2022-07-05T14:25:12.308Z|00161|dpdk|ERR|ice_dev_init(): Failed to load the DDP package,Use safe-mode-support=1 to enter Safe Mode 2022-07-05T14:25:12.308Z|00162|dpdk|INFO|EAL: Releasing PCI mapped resource for 0000:3b:00.1 2022-07-05T14:25:12.308Z|00163|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:3b:00.1 at 0x4207030000 2022-07-05T14:25:12.309Z|00164|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:3b:00.1 at 0x4209030000 2022-07-05T14:25:12.445Z|00165|dpdk|ERR|EAL: Driver cannot attach the device (0000:3b:00.1) 2022-07-05T14:25:12.445Z|00166|dpdk|ERR|EAL: Failed to attach device on primary process 2022-07-05T14:25:12.445Z|00167|netdev_dpdk|WARN|Error attaching device '0000:3b:00.1' to DPDK 2022-07-05T14:25:12.445Z|00168|netdev|WARN|dpdk1: could not set configuration (Invalid argument) 2022-07-05T14:25:12.445Z|00169|dpdk|ERR|Invalid port_id=1024 2022-07-05T14:25:13.094Z|00170|dpdk|INFO|EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:3b:00.0 (socket 0) 2022-07-05T14:25:13.162Z|00001|ovs_rcu(urcu2)|WARN|blocked 1000 ms waiting for main to quiesce 2022-07-05T14:25:13.296Z|00171|dpdk|WARN|EAL: libarchive not linked, /lib/firmware/intel/ice/ddp/ice.pkg.xz cannot be decompressed 2022-07-05T14:25:13.296Z|00172|dpdk|ERR|ice_load_pkg(): failed to search file path 2022-07-05T14:25:13.296Z|00173|dpdk|ERR|ice_dev_init(): Failed to load the DDP package,Use safe-mode-support=1 to enter Safe Mode 2022-07-05T14:25:13.296Z|00174|dpdk|INFO|EAL: Releasing PCI mapped resource for 0000:3b:00.0 2022-07-05T14:25:13.296Z|00175|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:3b:00.0 at 0x4209040000 2022-07-05T14:25:13.296Z|00176|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:3b:00.0 at 0x420b040000 2022-07-05T14:25:13.434Z|00177|dpdk|ERR|EAL: Driver cannot attach the device (0000:3b:00.0) 2022-07-05T14:25:13.434Z|00178|dpdk|ERR|EAL: Failed to attach device on primary process 2022-07-05T14:25:13.434Z|00179|netdev_dpdk|WARN|Error attaching device '0000:3b:00.0' to DPDK 2022-07-05T14:25:13.434Z|00001|dpdk(dpdk_watchdog1)|ERR|Invalid port_id=1024 2022-07-05T14:25:13.434Z|00180|netdev|WARN|dpdk0: could not set configuration (Invalid argument) 2022-07-05T14:25:13.434Z|00181|dpdk|ERR|Invalid port_id=1024 I can see that ddp package is present: [root@computeovsdpdksriov-r740 openvswitch]# find /lib/firmware/intel/ice/ -ls 6328699 0 drwxr-xr-x 4 root root 34 Jun 28 19:17 /lib/firmware/intel/ice/ 602986 0 drwxr-xr-x 2 root root 51 Jun 28 19:17 /lib/firmware/intel/ice/ddp 602987 24 -rw-r--r-- 1 root root 21088 Apr 12 14:55 /lib/firmware/intel/ice/ddp/ice-1.3.26.0.pkg.xz 602988 0 lrwxrwxrwx 1 root root 19 Apr 12 14:55 /lib/firmware/intel/ice/ddp/ice.pkg.xz -> ice-1.3.26.0.pkg.xz 2286601 0 drwxr-xr-x 2 root root 39 Jun 28 19:17 /lib/firmware/intel/ice/ddp-comms 2286602 24 -rw-r--r-- 1 root root 23844 Apr 12 14:55 /lib/firmware/intel/ice/ddp-comms/ice_comms-1.3.20.0.pkg.xz Version-Release number of selected component (if applicable): RHOS-17.0-RHEL-9-20220628.n.1 Linux computeovsdpdksriov-r740 5.14.0-70.17.1.el9_0.x86_64 #1 SMP PREEMPT Tue Jun 14 11:32:10 EDT 2022 x86_64 x86_64 x86_64 GNU/Linux I will attach templates and sos report How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
More info: [heat-admin@computeovsdpdksriov-r740 ~]$ driverctl list-overrides 0000:3b:00.0 vfio-pci 0000:3b:00.1 vfio-pci 0000:af:00.2 vfio-pci 0000:af:00.3 vfio-pci lshw ..... *-pci:2 description: PCI bridge product: Sky Lake-E PCI Express Root Port A vendor: Intel Corporation physical id: 102 bus info: pci@0000:3a:00.0 version: 04 width: 32 bits clock: 33MHz capabilities: pci normal_decode bus_master cap_list configuration: driver=pcieport resources: irq:29 memory:ab000000-ab1fffff ioport:ac000000(size=105906176) *-network:0 description: Ethernet controller product: Ethernet Controller E810-C for QSFP vendor: Intel Corporation physical id: 0 bus info: pci@0000:3b:00.0 version: 02 width: 64 bits clock: 33MHz capabilities: cap_list rom configuration: driver=vfio-pci latency=0 resources: irq:89 memory:ae000000-afffffff memory:b2010000-b201ffff memory:ab000000-ab0fffff memory:b1000000-b1ffffff memory:b2220000-b241ffff *-network:1 description: Ethernet controller product: Ethernet Controller E810-C for QSFP vendor: Intel Corporation physical id: 0.1 bus info: pci@0000:3b:00.1 version: 02 width: 64 bits clock: 33MHz capabilities: cap_list rom configuration: driver=vfio-pci latency=0 resources: irq:89 memory:ac000000-adffffff memory:b2000000-b200ffff memory:ab100000-ab1fffff memory:b0000000-b0ffffff memory:b2020000-b221ffff
Verified in puddle RHOS-17.0-RHEL-9-20220811.n.0 [root@computeovsdpdksriov-r740 heat-admin]# dmesg | grep DDP [ 143.732484] ice 0000:3b:00.0: The DDP package was successfully loaded: ICE OS Default Package version 1.3.26.0 [ 147.690110] ice 0000:3b:00.1: DDP package already present on device: ICE OS Default Package version 1.3.26.0 ovs-vsctl show 86c84941-1a8a-4ded-930b-4cd4dccb81d5 Manager "ptcp:6640:127.0.0.1" is_connected: true Bridge br-dpdk0 fail_mode: standalone datapath_type: netdev Port br-dpdk0 Interface br-dpdk0 type: internal Port dpdk2 Interface dpdk2 type: dpdk options: {dpdk-devargs="0000:af:00.2"} Bridge br-link0 fail_mode: standalone datapath_type: netdev Port br-link0 tag: 171 Interface br-link0 type: internal Port dpdkbond0 Interface dpdk1 type: dpdk options: {dpdk-devargs="0000:3b:00.1", n_rxq="1"} Interface dpdk0 type: dpdk options: {dpdk-devargs="0000:3b:00.0", n_rxq="1"} Bridge br-int fail_mode: secure datapath_type: netdev Port ovn-c9a511-0 Interface ovn-c9a511-0 type: geneve options: {csum="true", key=flow, remote_ip="10.10.171.175"} Port br-int Interface br-int type: internal Port ovn-17ba34-0 Interface ovn-17ba34-0 type: geneve options: {csum="true", key=flow, remote_ip="10.10.171.138"} Port ovn-42df8c-0 Interface ovn-42df8c-0 type: geneve options: {csum="true", key=flow, remote_ip="10.10.171.146"} Port ovn-8c3959-0 Interface ovn-8c3959-0 type: geneve options: {csum="true", key=flow, remote_ip="10.10.171.137"} Bridge br-dpdk1 fail_mode: standalone datapath_type: netdev Port br-dpdk1 Interface br-dpdk1 type: internal Port dpdk3 Interface dpdk3 type: dpdk options: {dpdk-devargs="0000:af:00.3"} ovs_version: "2.17.3"
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Release of components for Red Hat OpenStack Platform 17.0 (Wallaby)), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2022:6543