Hide Forgot
Description of problem: NFP can't be used for OVS DPDK caused by "A CPP handle can not be obtained" ERR with Selinux=Enforcing. 018-04-23T13:38:48.173Z|00021|dpdk|INFO|EAL: PCI device 0000:81:00.0 on NUMA socket 1 2018-04-23T13:38:48.173Z|00022|dpdk|INFO|EAL: probe driver: 19ee:4000 net_nfp_pf 2018-04-23T13:38:48.174Z|00023|dpdk|INFO|EAL: using IOMMU type 1 (Type 1) 2018-04-23T13:38:48.465Z|00024|dpdk|ERR|PMD: A CPP handle can not be obtained 2018-04-23T13:38:48.465Z|00025|dpdk|INFO|EAL: Releasing pci mapped resource for 0000:81:00.0 2018-04-23T13:38:48.465Z|00026|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:81:00.0 at 0x7ff340000000 2018-04-23T13:38:48.465Z|00027|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:81:00.0 at 0x7ff348000000 2018-04-23T13:38:48.465Z|00028|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:81:00.0 at 0x7ff34c000000 2018-04-23T13:38:48.624Z|00029|dpdk|ERR|EAL: Requested device 0000:81:00.0 cannot be used Also, check the following related bug: https://bugzilla.redhat.com/show_bug.cgi?id=1566712 Due to this bug OVS-dpdk/NFP cannot be run as: OVS_USER_ID="openvswitch:hugetlbfs" This might caused the issue here. Version-Release number of selected component (if applicable): [root@netqe7 ~]# uname -a Linux netqe7.knqe.lab.eng.bos.redhat.com 3.10.0-862.el7.x86_64 #1 SMP Wed Mar 21 18:14:51 EDT 2018 x86_64 x86_64 x86_64 GNU/Linux [root@netqe7 ~]# rpm -q openvswitch openvswitch-2.9.0-17.el7fdp.x86_64 How reproducible: Reproducible Steps to Reproduce: 1. Edit /etc/sysconfig/openvswitch to comment out OVS_USER_ID line: #OVS_USER_ID="openvswitch:hugetlbfs" 2. setenforce 1 3. Use driverctl to bind the NFP 4. systemctl start openvswitch Actual results: failed --- see description above. Expected results: Should succeed Additional info:
Jean did you install the SELinux profiles needed? yum install http://download-ipv4.eng.brq.redhat.com/brewroot/packages/openstack-selinux/0.8.13/2.el7ost/noarch/openstack-selinux-0.8.13-2.el7ost.noarch.rpm \ http://download-ipv4.eng.brq.redhat.com/brewroot/packages/container-selinux/2.41/1.git126c1c0.el7/noarch/container-selinux-2.41-1.git126c1c0.el7.noarch.rpm I quickly tried it in my lab and works fine with these profiles installed.
Hi Eelco, Mine are newer: [root@netqe7 ~]# rpm -qa | grep selinux libselinux-2.5-12.el7.x86_64 container-selinux-2.51-1.el7.noarch selinux-policy-targeted-3.13.1-192.el7.noarch libselinux-utils-2.5-12.el7.x86_64 libselinux-python-2.5-12.el7.x86_64 openstack-selinux-0.8.14-0.20180221131810.4e6703e.el7ost.noarch selinux-policy-3.13.1-192.el7.noarch Remember that we need to comment out this line: #OVS_USER_ID="openvswitch:hugetlbfs" Thanks! Jean
Please follow this reproducer. Before staring OVS and configuring anything, setenforce 1; bind NFP first; tail -f the daemon log, and then start OVS. You should see ERR coming out when OVS is up. See the log with ERR here. { 2018-04-26T18:25:46.289Z|00021|dpdk|INFO|EAL: PCI device 0000:81:00.0 on NUMA socket 1 2018-04-26T18:25:46.289Z|00022|dpdk|INFO|EAL: probe driver: 19ee:4000 net_nfp_pf 2018-04-26T18:25:46.291Z|00023|dpdk|INFO|EAL: using IOMMU type 1 (Type 1) 2018-04-26T18:25:46.580Z|00024|dpdk|ERR|PMD: A CPP handle can not be obtained 2018-04-26T18:25:46.580Z|00025|dpdk|INFO|EAL: Releasing pci mapped resource for 0000:81:00.0 2018-04-26T18:25:46.580Z|00026|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:81:00.0 at 0x7f07c0000000 2018-04-26T18:25:46.580Z|00027|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:81:00.0 at 0x7f07c8000000 2018-04-26T18:25:46.580Z|00028|dpdk|INFO|EAL: Calling pci_unmap_resource for 0000:81:00.0 at 0x7f07cc000000 2018-04-26T18:25:46.739Z|00029|dpdk|ERR|EAL: Requested device 0000:81:00.0 cannot be used } Please let me know your result. Thanks! Jean
Closing this BZ as a duplicate of BZ1568301 after hacking http://dpdk.org/ml/archives/stable/2018-April/006311.html in NFP CPP patch confirmed this is the same issue. *** This bug has been marked as a duplicate of bug 1568301 ***