Created attachment 1239207 [details] compute node networking Description of problem: HPE's NFV System reference architecture provides choices to customers using either accelerated vSwitch (like OVS-DPDK) or hardware acceleration (using SRIOV or PCI-PT) to achieve line rate performance to their VNF workloads. From hardware perspective, the compute nodes are provisioned with 2 NIC cards with dual ports. 2 ports dedicated for vSwitch and 2 ports for SR-IOV/PCI-PT. With RHOSP10, OSPd supports configuring computes either with OVS-DPDK or OVS + SRIOV-PCI/PT. Compute nodes which are configured with OVS-DPDK are inefficiently used as the remaining 2 ports are just kept idle. The requirement here is to accommodate both hw and sw acceleration on the same compute node to provide effective use of the compute nodes. See the attachment for compute node networking.
Planned for RHOSP12, we may have to push it in RHOSP13 if heavy developments are required in TripleO. But we will evaluate the work to be done in the coming week and provide an update.
*** Bug 1457381 has been marked as a duplicate of this bug. ***
Hi, What is the current support status of "upport configuring SRIOV and OVS-DPDK interfaces on the same compute node" * The templates are obviously coming with Pike (OSP 12) or later? * Has this been tested without Director - meaning without the templates, only OVS 2.6.1 and SR-IOV combined, does this work right now? Thanks, Andreas
Hi Surya, Could you provide more details regarding the hardware specified on the attached image? By the image provided, I can see that two interfaces used for the dataplane. Port 0 from NIC 1 and port 0 from NIC 2 bonded together. I wonder if the host has one single cpu or multiple cpus? In case of multiple cpus, the above structure could not be used as it will result in a performance degradation, because the interface cards will probably reside in two different numa nodes. Thanks, Maxim.
Hi Maxim, We connected the ports in this way for HA. Even if one intel nic with 2 ports(1.1 and 1.2) goes down we will have connectivity to the VM through the other port from 2nd nic(2.1 and 2.2) Thanks, Surya
*** Bug 1500130 has been marked as a duplicate of this bug. ***
Verified for Pike https://polarion.engineering.redhat.com/polarion/#/project/RHELOpenStackPlatform/workitem?id=RHELOSP-29370&revision=4605446
Hi, I assumed nic1 and nic2 are on different NUMA nodes (numa0 and numa1 respectively). In case of SR-IOV, can VM on numa0 use the SR-IOV port on nic2? Is it a must to have across-numa VM deployment for this case? Thanks, Yongjun
Hi Yongjun, Yes, this is possible. Explanations: OVS-DPDK is not NUMA aware, so both NUMA nodes can be used SR-IOV is NUMA aware or not depending on how you configures the nova filters => OVS-DPDK + SR-IOV will behave like according to SR-IOV NIC with regards to NUMA.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2017:3462