Bug 2104130
| Summary: | openvswitch failing to load DDP package | |||
|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Miguel Angel Nieto <mnietoji> | |
| Component: | openvswitch | Assignee: | Haresh Khandelwal <hakhande> | |
| Status: | CLOSED ERRATA | QA Contact: | Sanjay Upadhyay <supadhya> | |
| Severity: | high | Docs Contact: | ||
| Priority: | medium | |||
| Version: | 17.0 (Wallaby) | CC: | apevec, cfontain, chrisw, dmarchan, hakhande, jschluet, oblaut, tredaelli, vcandapp | |
| Target Milestone: | ga | Keywords: | Bugfix, Regression, Triaged | |
| Target Release: | 17.0 | |||
| Hardware: | Unspecified | |||
| OS: | Unspecified | |||
| Whiteboard: | ||||
| Fixed In Version: | Doc Type: | If docs needed, set a value | ||
| Doc Text: | Story Points: | --- | ||
| Clone Of: | ||||
| : | 2104548 (view as bug list) | Environment: | ||
| Last Closed: | 2022-09-21 12:23:40 UTC | Type: | Bug | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | 1965867, 2104548 | |||
| Bug Blocks: | ||||
More info:
[heat-admin@computeovsdpdksriov-r740 ~]$ driverctl list-overrides
0000:3b:00.0 vfio-pci
0000:3b:00.1 vfio-pci
0000:af:00.2 vfio-pci
0000:af:00.3 vfio-pci
lshw
.....
*-pci:2
description: PCI bridge
product: Sky Lake-E PCI Express Root Port A
vendor: Intel Corporation
physical id: 102
bus info: pci@0000:3a:00.0
version: 04
width: 32 bits
clock: 33MHz
capabilities: pci normal_decode bus_master cap_list
configuration: driver=pcieport
resources: irq:29 memory:ab000000-ab1fffff ioport:ac000000(size=105906176)
*-network:0
description: Ethernet controller
product: Ethernet Controller E810-C for QSFP
vendor: Intel Corporation
physical id: 0
bus info: pci@0000:3b:00.0
version: 02
width: 64 bits
clock: 33MHz
capabilities: cap_list rom
configuration: driver=vfio-pci latency=0
resources: irq:89 memory:ae000000-afffffff memory:b2010000-b201ffff memory:ab000000-ab0fffff memory:b1000000-b1ffffff memory:b2220000-b241ffff
*-network:1
description: Ethernet controller
product: Ethernet Controller E810-C for QSFP
vendor: Intel Corporation
physical id: 0.1
bus info: pci@0000:3b:00.1
version: 02
width: 64 bits
clock: 33MHz
capabilities: cap_list rom
configuration: driver=vfio-pci latency=0
resources: irq:89 memory:ac000000-adffffff memory:b2000000-b200ffff memory:ab100000-ab1fffff memory:b0000000-b0ffffff memory:b2020000-b221ffff
Verified in puddle RHOS-17.0-RHEL-9-20220811.n.0
[root@computeovsdpdksriov-r740 heat-admin]# dmesg | grep DDP
[ 143.732484] ice 0000:3b:00.0: The DDP package was successfully loaded: ICE OS Default Package version 1.3.26.0
[ 147.690110] ice 0000:3b:00.1: DDP package already present on device: ICE OS Default Package version 1.3.26.0
ovs-vsctl show
86c84941-1a8a-4ded-930b-4cd4dccb81d5
Manager "ptcp:6640:127.0.0.1"
is_connected: true
Bridge br-dpdk0
fail_mode: standalone
datapath_type: netdev
Port br-dpdk0
Interface br-dpdk0
type: internal
Port dpdk2
Interface dpdk2
type: dpdk
options: {dpdk-devargs="0000:af:00.2"}
Bridge br-link0
fail_mode: standalone
datapath_type: netdev
Port br-link0
tag: 171
Interface br-link0
type: internal
Port dpdkbond0
Interface dpdk1
type: dpdk
options: {dpdk-devargs="0000:3b:00.1", n_rxq="1"}
Interface dpdk0
type: dpdk
options: {dpdk-devargs="0000:3b:00.0", n_rxq="1"}
Bridge br-int
fail_mode: secure
datapath_type: netdev
Port ovn-c9a511-0
Interface ovn-c9a511-0
type: geneve
options: {csum="true", key=flow, remote_ip="10.10.171.175"}
Port br-int
Interface br-int
type: internal
Port ovn-17ba34-0
Interface ovn-17ba34-0
type: geneve
options: {csum="true", key=flow, remote_ip="10.10.171.138"}
Port ovn-42df8c-0
Interface ovn-42df8c-0
type: geneve
options: {csum="true", key=flow, remote_ip="10.10.171.146"}
Port ovn-8c3959-0
Interface ovn-8c3959-0
type: geneve
options: {csum="true", key=flow, remote_ip="10.10.171.137"}
Bridge br-dpdk1
fail_mode: standalone
datapath_type: netdev
Port br-dpdk1
Interface br-dpdk1
type: internal
Port dpdk3
Interface dpdk3
type: dpdk
options: {dpdk-devargs="0000:af:00.3"}
ovs_version: "2.17.3"
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Release of components for Red Hat OpenStack Platform 17.0 (Wallaby)), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2022:6543 |
Description of problem: I am trying to deploy a setup in which a E810C nic is configured in openvswitch and it openvswitch is failing with the following error: Bridge br-link0 fail_mode: standalone datapath_type: netdev Port br-link0 tag: 171 Interface br-link0 type: internal Port dpdkbond0 Interface dpdk1 type: dpdk options: {dpdk-devargs="0000:3b:00.1", n_rxq="1"} error: "Error attaching device '0000:3b:00.1' to DPDK" Interface dpdk0 type: dpdk options: {dpdk-devargs="0000:3b:00.0", n_rxq="1"} error: "Error attaching device '0000:3b:00.0' to DPDK" 2022-07-05T14:25:12.106Z|00158|dpdk|INFO|EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:3b:00.1 (socket 0) 2022-07-05T14:25:12.308Z|00159|dpdk|WARN|EAL: libarchive not linked, /lib/firmware/intel/ice/ddp/ice.pkg.xz cannot be decompressed 2022-07-05T14:25:12.308Z|00160|dpdk|ERR|ice_load_pkg(): failed to search file path 2022-07-05T14:25:12.308Z|00161|dpdk|ERR|ice_dev_init(): Failed to load the DDP package,Use safe-mode-support=1 to enter Safe Mode 2022-07-05T14:25:12.308Z|00162|dpdk|INFO|EAL: Releasing PCI mapped resource for 0000:3b:00.1 2022-07-05T14:25:12.308Z|00163|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:3b:00.1 at 0x4207030000 2022-07-05T14:25:12.309Z|00164|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:3b:00.1 at 0x4209030000 2022-07-05T14:25:12.445Z|00165|dpdk|ERR|EAL: Driver cannot attach the device (0000:3b:00.1) 2022-07-05T14:25:12.445Z|00166|dpdk|ERR|EAL: Failed to attach device on primary process 2022-07-05T14:25:12.445Z|00167|netdev_dpdk|WARN|Error attaching device '0000:3b:00.1' to DPDK 2022-07-05T14:25:12.445Z|00168|netdev|WARN|dpdk1: could not set configuration (Invalid argument) 2022-07-05T14:25:12.445Z|00169|dpdk|ERR|Invalid port_id=1024 2022-07-05T14:25:13.094Z|00170|dpdk|INFO|EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:3b:00.0 (socket 0) 2022-07-05T14:25:13.162Z|00001|ovs_rcu(urcu2)|WARN|blocked 1000 ms waiting for main to quiesce 2022-07-05T14:25:13.296Z|00171|dpdk|WARN|EAL: libarchive not linked, /lib/firmware/intel/ice/ddp/ice.pkg.xz cannot be decompressed 2022-07-05T14:25:13.296Z|00172|dpdk|ERR|ice_load_pkg(): failed to search file path 2022-07-05T14:25:13.296Z|00173|dpdk|ERR|ice_dev_init(): Failed to load the DDP package,Use safe-mode-support=1 to enter Safe Mode 2022-07-05T14:25:13.296Z|00174|dpdk|INFO|EAL: Releasing PCI mapped resource for 0000:3b:00.0 2022-07-05T14:25:13.296Z|00175|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:3b:00.0 at 0x4209040000 2022-07-05T14:25:13.296Z|00176|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:3b:00.0 at 0x420b040000 2022-07-05T14:25:13.434Z|00177|dpdk|ERR|EAL: Driver cannot attach the device (0000:3b:00.0) 2022-07-05T14:25:13.434Z|00178|dpdk|ERR|EAL: Failed to attach device on primary process 2022-07-05T14:25:13.434Z|00179|netdev_dpdk|WARN|Error attaching device '0000:3b:00.0' to DPDK 2022-07-05T14:25:13.434Z|00001|dpdk(dpdk_watchdog1)|ERR|Invalid port_id=1024 2022-07-05T14:25:13.434Z|00180|netdev|WARN|dpdk0: could not set configuration (Invalid argument) 2022-07-05T14:25:13.434Z|00181|dpdk|ERR|Invalid port_id=1024 I can see that ddp package is present: [root@computeovsdpdksriov-r740 openvswitch]# find /lib/firmware/intel/ice/ -ls 6328699 0 drwxr-xr-x 4 root root 34 Jun 28 19:17 /lib/firmware/intel/ice/ 602986 0 drwxr-xr-x 2 root root 51 Jun 28 19:17 /lib/firmware/intel/ice/ddp 602987 24 -rw-r--r-- 1 root root 21088 Apr 12 14:55 /lib/firmware/intel/ice/ddp/ice-1.3.26.0.pkg.xz 602988 0 lrwxrwxrwx 1 root root 19 Apr 12 14:55 /lib/firmware/intel/ice/ddp/ice.pkg.xz -> ice-1.3.26.0.pkg.xz 2286601 0 drwxr-xr-x 2 root root 39 Jun 28 19:17 /lib/firmware/intel/ice/ddp-comms 2286602 24 -rw-r--r-- 1 root root 23844 Apr 12 14:55 /lib/firmware/intel/ice/ddp-comms/ice_comms-1.3.20.0.pkg.xz Version-Release number of selected component (if applicable): RHOS-17.0-RHEL-9-20220628.n.1 Linux computeovsdpdksriov-r740 5.14.0-70.17.1.el9_0.x86_64 #1 SMP PREEMPT Tue Jun 14 11:32:10 EDT 2022 x86_64 x86_64 x86_64 GNU/Linux I will attach templates and sos report How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info: