Description of problem: ice card: some ovs dpdk pvp multiple queues cases on rhel9 got lower performance than rhel8 Version-Release number of selected component (if applicable): How reproducible: Steps to Reproduce: DUT <--directly connect--> Trex server DUT: build ovs dpdk pvp topo, start testpmd inside guest. Trex server: send rfc2544 traffic Actual results: some ovs dpdk pvp multiple queues cases on rhel9.2/rhel9.0 got lower performance than rhel8.6 For ovs2.17 and ovs3.1, 2q and 4q cases got lower performance on rhel9.2/9.0 than rhel8.6. >>>netqe45 hp 25g ice card: rhel8.6 ovs2.17 https://beaker.engineering.redhat.com/jobs/7709466 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77094/7709466/13684355/158518591/ice_25.html 64byte viommu novlan 1q 2pmd: 6.4mpps 64byte viommu novlan 1q 4pmd: 12.1mpps 64byte viommu novlan 2q 4pmd: 12.3mpps 64byte viommu novlan 4q 8pmd: 23.8mpps 64byte noviommu vlan 1q 2pmd: 5.9mpps 64byte noviommu vlan 1q 4pmd: 9.9mpps 64byte noviommu vlan 2q 4pmd: 11.2mpps 64byte noviommu vlan 4q 8pmd: 21.5mpps rhel9.2 ovs2.17 1q viommu case: https://beaker.engineering.redhat.com/jobs/7722408 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77224/7722408/13705541/158651636/ice_25.html other case: https://beaker.engineering.redhat.com/jobs/7704748 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77047/7704748/13677917/158482243/ice_25.html 64byte viommu novlan 1q 2pmd: 5.7mpps 64byte viommu novlan 1q 4pmd: 12mpps 64byte viommu novlan 2q 4pmd: 11mpps(compare above ovs2.17 on rhel8.6,reduced by 10%) 64byte viommu novlan 4q 8pmd: 23.7mpps 64byte noviommu vlan 1q 2pmd: 5.5mpps 64byte noviommu vlan 1q 4pmd: 10mpps 64byte noviommu vlan 2q 4pmd: 9.0mpps(compare above ovs2.17 on rhel8.6,reduced by 10%) 64byte noviommu vlan 4q 8pmd: 18.4mpps(compare above ovs2.17 on rhel8.6,reduced by 14%) rhel8.6 ovs3.1 https://beaker.engineering.redhat.com/jobs/7724595 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77245/7724595/13708757/158674869/ice_25.html 64byte viommu novlan 1q 2pmd: 6.3mpps 64byte viommu novlan 1q 4pmd: 11.8mpps 64byte viommu novlan 2q 4pmd: 12.2mpps 64byte viommu novlan 4q 8pmd: 23.8mpps 64byte noviommu vlan 1q 2pmd: 5.2mpps 64byte noviommu vlan 1q 4pmd: 9.7mpps 64byte noviommu vlan 2q 4pmd: 11.1mpps 64byte noviommu vlan 4q 8pmd: 21.2mpps rhel9.2 ovs3.1 https://beaker.engineering.redhat.com/jobs/7719511 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77195/7719511/13701071/158626832/ice_25.html https://beaker.engineering.redhat.com/jobs/7704748 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77047/7704748/13677917/158482243/ice_25.html https://beaker.engineering.redhat.com/jobs/7722408 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77224/7722408/13705541/158651636/ice_25.html 64byte viommu novlan 1q 2pmd: 5.6mpps 64byte viommu novlan 1q 4pmd: 11.8mpps 64byte viommu novlan 2q 4pmd: 10.8mpps(compare above ovs3.1 on rhel8.6,reduced by 10%) 64byte viommu novlan 4q 8pmd: 23.3mpps 64byte noviommu vlan 1q 2pmd: 4.5mpps 64byte noviommu vlan 1q 4pmd: 9.8mpps 64byte noviommu vlan 2q 4pmd: 10.9mpps 64byte noviommu vlan 4q 8pmd: 19.2mpps >>>740-57 dell 25g ice fdp23.b rhel8.6 ovs2.17 https://beaker.engineering.redhat.com/jobs/7537869 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/02/75378/7537869/13403411/156354415/ice_25.html 64byte viommu novlan 1q 2pmd: 4.9mpps 64byte viommu novlan 1q 4pmd: 8.6mpps 64byte viommu novlan 2q 4pmd: 9.1mpps 64byte viommu novlan 4q 8pmd: 17.2mpps 64byte noviommu vlan 1q 2pmd: 4.0mpps 64byte noviommu vlan 1q 4pmd: 6.9mpps 64byte noviommu vlan 2q 4pmd: 7.9mpps 64byte noviommu vlan 4q 8pmd: 13.8mpps fdp23.c rhel8.6 ovs2.17 https://beaker.engineering.redhat.com/jobs/7711592 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77115/7711592/13687702/158538415/ice_25.html https://beaker.engineering.redhat.com/jobs/7631111 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/03/76311/7631111/13557238/157586892/ice_25.html 64byte viommu novlan 1q 2pmd: 4.9mpps 64byte viommu novlan 1q 4pmd: 8.3mpps 64byte viommu novlan 2q 4pmd: 9.1mpps 64byte viommu novlan 4q 8pmd: 17.1mpps 64byte noviommu 1q 2pmd: 3.9mpps 64byte noviommu 1q 4pmd: 6.7mpps 64byte noviommu 2q 4pmd: 7.3mpps 64byte noviommu 4q 8pmd: 13.6mpps fdp23.c rhel9.2 ovs2.17 https://beaker.engineering.redhat.com/jobs/7635259 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/03/76352/7635259/13565170/157653085/ice_25.html 64byte viommu novlan 1q 2pmd: 4.8mpps 64byte viommu novlan 1q 4pmd: 8.1mpps 64byte viommu novlan 2q 4pmd: 9mpps 64byte viommu novlan 4q 8pmd: 14.1mpps(compare above ovs2.17 on rhel8.6,reduced by 17%) 64byte noviommu vlan 1q 2pmd: 3.2mpps 64byte noviommu vlan 1q 4pmd: 6.7mpps 64byte noviommu vlan 2q 4pmd: 6.6mpps 64byte noviommu vlan 4q 8pmd: 13.9mpps fdp23.b rhel9.0 ovs2.17 https://beaker.engineering.redhat.com/jobs/7539500 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/02/75395/7539500/13406159/156372849/ice_25.html 64byte viommu novlan 1q 2pmd: 4.2mpps 64byte viommu novlan 1q 4pmd: 6.7mpps 64byte viommu novlan 2q 4pmd: 8.3mpps 64byte viommu novlan 4q 8pmd: 14.1mpps(compare above ovs2.17 on rhel8.6,reduced by 10%) 64byte noviommu vlan 1q 2pmd: 5.2mpps 64byte noviommu 1q 4pmd: 8.5mpps 64byte noviommu 2q 4pmd: 8.1mpps 64byte noviommu 4q 8pmd: 17.3mpps fdp23.b rhel8.6 ovs3.1 https://beaker.engineering.redhat.com/jobs/7577363 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/02/75773/7577363/13467307/156828431/ice_25.html 64byte viommu novlan 1q 2pmd: 4.9mpps 64byte viommu novlan 1q 4pmd: 8.6mpps 64byte viommu novlan 2q 4pmd: 9.1mpps 64byte viommu novlan 4q 8pmd: 17.2mpps 64byte noviommu 1q 2pmd: 4.0mpps 64byte noviommu 1q 4pmd: 6.9mpps 64byte noviommu 2q 4pmd: 7.9mpps 64byte noviommu 4q 8pmd: 13.8mpps fdp23.c rhel8.6 ovs3.1 https://beaker.engineering.redhat.com/jobs/7711597 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/04/77115/7711597/13687709/158538449/ice_25.html 64byte viommu novlan 1q 2pmd: 4.7mpps 64byte viommu novlan 1q 4pmd: 8.2mpps 64byte viommu novlan 2q 4pmd: 9.4mpps 64byte viommu novlan 4q 8pmd: 17.3mpps 64byte noviommu 1q 2pmd: 4.0mpps 64byte noviommu 1q 4pmd: 6.7mpps 64byte noviommu 2q 4pmd: 7.5mpps 64byte noviommu 4q 8pmd: 13.5mpps fdp23.c rhel9.2 ovs3.1 https://beaker.engineering.redhat.com/jobs/7631127 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/03/76311/7631127/13557257/157586957/ice_25.html 64byte viommu novlan 1q 2pmd: 4.0mpps 64byte viommu novlan 1q 4pmd: 8.3mpps 64byte viommu novlan 2q 4pmd: 9.4mpps 64byte viommu novlan 4q 8pmd: 14.4mpps(compare above ovs3.1 on rhel8.6,reduced by 16%) 64byte noviommu 1q 2pmd: 4.2mpps 64byte noviommu 1q 4pmd: 6.8mpps 64byte noviommu 2q 4pmd: 6.5mpps(compare above ovs3.1 on rhel8.6,reduced by 13%) 64byte noviommu 4q 8pmd: 14.4mpps fdp23.b rhel9.0 ovs3.1 https://beaker.engineering.redhat.com/jobs/7564557 https://beaker-archive.hosts.prod.psi.bos.redhat.com/beaker-logs/2023/02/75645/7564557/13447604/156698539/ice_25.html 64byte viommu novlan 1q 2pmd: 4.9mpps 64byte viommu novlan 1q 4pmd: 8.1mpps 64byte viommu novlan 2q 4pmd: 9.7mpps 64byte viommu novlan 4q 8pmd: 14.4mpps(compare above ovs3.1 on rhel8.6,reduced by 13%) 64byte noviommu 1q 2pmd: 4.1mpps 64byte noviommu 1q 4pmd: 6.8mpps 64byte noviommu 2q 4pmd: 8.3mpps 64byte noviommu 4q 8pmd: 12.9mpps Expected results: some ovs dpdk pvp multiple queues cases on rhel9.2/rhel9.0 should not got lower performance than rhel8.6 Additional info: