RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1935690 - call trace Code: Bad RIP value occur when run ovs performance test
Summary: call trace Code: Bad RIP value occur when run ovs performance test
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat Enterprise Linux 8
Classification: Red Hat
Component: kernel-rt
Version: 8.3
Hardware: x86_64
OS: Linux
unspecified
urgent
Target Milestone: rc
: ---
Assignee: Peter Xu
QA Contact: mhou
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-03-05 11:50 UTC by mhou
Modified: 2021-03-29 12:15 UTC (History)
12 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-03-29 12:15:09 UTC
Type: Bug
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)

Description mhou 2021-03-05 11:50:58 UTC
Description of problem:

when run rfc2544 test, occured call trace.
Version-Release number of selected component (if applicable):
kernel version:
4.18.0-240.15.1.rt7.69.el8_3.x86_64
qemu version:
http://download.eng.pek2.redhat.com/rhel-8/nightly/ADVANCED-VIRT-8/latest-ADVANCED-VIRT-8.3.1-RHEL-8/compose/Advanced-virt/x86_64/os

ovs version:
http://download-node-02.eng.bos.redhat.com/brewroot/packages/openvswitch-selinux-extra-policy/1.0/28.el8fdp/noarch/openvswitch-selinux-extra-policy-1.0-28.el8fdp.noarch.rpm
http://download-node-02.eng.bos.redhat.com/brewroot/packages/openvswitch2.15/2.15.0/1.el8fdp/x86_64/openvswitch2.15-2.15.0-1.el8fdp.x86_64.rpm

dpdk version:
http://download-node-02.eng.bos.redhat.com/brewroot/packages/dpdk/19.11.3/1.el8/x86_64/dpdk-19.11.3-1.el8.x86_64.rpm
http://download-node-02.eng.bos.redhat.com/brewroot/packages/dpdk/19.11.3/1.el8/x86_64/dpdk-tools-19.11.3-1.el8.x86_64.rpm

How reproducible:
1/1

Steps to Reproduce:
beaker job:https://beaker.engineering.redhat.com/jobs/5159657
console log:https://beaker-archive.host.prod.eng.bos.redhat.com/beaker-logs/2021/03/51596/5159657/9666279/console.log

Actual results:
[ 4344.851987] Call Trace:
[ 4344.851987]  <IRQ>
[ 4344.851987]  dump_stack+0x5c/0x80
[ 4344.851987]  nmi_cpu_backtrace.cold.4+0x13/0x4e
[ 4344.851987]  nmi_trigger_cpumask_backtrace+0x116/0x129
[ 4344.851987]  rcu_dump_cpu_stacks+0x9c/0xca
[ 4344.851987]  rcu_sched_clock_irq.cold.63+0x17c/0x508
[ 4344.851987]  ? tick_sched_do_timer+0x70/0x70
[ 4344.851987]  update_process_times+0x24/0x60
[ 4344.851987]  tick_sched_handle+0x22/0x60
[ 4344.851987]  tick_sched_timer+0x43/0x80
[ 4344.851987]  __hrtimer_run_queues+0x11d/0x3b0
[ 4344.851987]  hrtimer_interrupt+0x10a/0x220
[ 4344.851987]  ? rto_push_irq_work_func+0xbb/0x130
[ 4344.851987]  smp_apic_timer_interrupt+0x9d/0x220
[ 4344.851987]  apic_timer_interrupt+0xf/0x20
[ 4344.851987]  </IRQ>
[ 4344.851987] RIP: 0010:handle_external_interrupt_irqoff+0x80/0x110 [kvm_intel]
[ 4344.851987] Code: 10 48 c1 e0 20 48 09 c3 0f b7 06 48 09 c3 e8 57 c8 11 f2 65 48 89 2d 07 12 30 3f 48 89 e0 48 83 e4 f0 6a 18 50 9c 6a 10 ff d3 <90> 90
[ 4344.851987] RSP: 0018:ffffb92ece00fd08 EFLAGS: 00000086 ORIG_RAX: ffffffffffffff13
[ 4344.851987] RAX: ffffb92ece00fd08 RBX: ffffffffb3401b90 RCX: 00001aaec4a746aa
[ 4344.851987] RDX: 0000000080000000 RSI: ffffffffc0d51d34 RDI: ffffffffb3ae1e0e
[ 4344.851987] RBP: ffff972d3b068000 R08: 0000000055555554 R09: 0000000000000000
[ 4344.851987] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[ 4344.851987] R13: 0000000000000000 R14: ffff972d3b068038 R15: ffff9726cee8a700
[ 4344.851987]  ? __irqentry_text_start+0x8/0x8
[ 4344.851987]  ? handle_external_interrupt_irqoff+0x69/0x110 [kvm_intel]
[ 4344.851987]  ? vcpu_enter_guest+0x24d/0x1950 [kvm]
[ 4344.851987]  ? kvm_get_running_vcpu+0x2e/0x70 [kvm]
[ 4344.851987]  ? vmx_deliver_posted_interrupt+0x6f/0x110 [kvm_intel]
[ 4344.851987]  ? __apic_accept_irq+0x19c/0x340 [kvm]
[ 4344.851987]  ? kvm_arch_vcpu_ioctl_run+0xfa/0x560 [kvm]
[ 4344.851987]  ? kvm_vcpu_ioctl+0x22a/0x630 [kvm]
[ 4344.851987]  ? apic_timer_interrupt+0xa/0x20
[ 4344.851987]  ? do_vfs_ioctl+0xa4/0x640
[ 4344.851987]  ? ksys_ioctl+0x60/0x90
[ 4344.851987]  ? __x64_sys_ioctl+0x16/0x20
[ 4344.851987]  ? do_syscall_64+0x87/0x1a0
[ 4344.851987]  ? entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4362.759501] INFO: task systemd-udevd:1424 blocked for more than 600 seconds.
[ 4362.766590]       Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4362.775586] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4362.783454] systemd-udevd   D    0  1424      1 0x00080324
[ 4362.788947] Call Trace:
[ 4362.791415]  __schedule+0x372/0x910
[ 4362.794939]  ? _raw_spin_lock_irq+0x1a/0x40
[ 4362.799150]  schedule+0x3c/0xe0
[ 4362.802321]  rt_spin_lock_slowlock_locked+0x10e/0x2b0
[ 4362.807409]  rt_spin_lock_slowlock+0x50/0x80
[ 4362.811718]  __local_bh_disable_ip+0x7f/0xa0
[ 4362.816025]  unix_create1+0x1dc/0x210
[ 4362.819717]  unix_create+0x37/0x70
[ 4362.823147]  __sock_create+0x102/0x1b0
[ 4362.826934]  __sys_socket+0x57/0xe0
[ 4362.830452]  __x64_sys_socket+0x16/0x20
[ 4362.834310]  do_syscall_64+0x87/0x1a0
[ 4362.837985]  entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4362.843063] RIP: 0033:0x7f01d05f05ab
[ 4362.846669] Code: Bad RIP value.
[ 4362.849927] RSP: 002b:00007ffefbdfe388 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
[ 4362.857538] RAX: ffffffffffffffda RBX: 00007f01d151a53b RCX: 00007f01d05f05ab
[ 4362.864678] RDX: 0000000000000000 RSI: 0000000000080002 RDI: 0000000000000001
[ 4362.871844] RBP: 00007ffefbdfe4c0 R08: 0000000000000000 R09: 0000000000000004
[ 4362.879020] R10: 0098cef393544260 R11: 0000000000000246 R12: 000000000000000b
[ 4362.886187] R13: 00007ffefbdfe580 R14: 00007ffefbdfe400 R15: 0000000000000000
[ 4362.893404] INFO: task qemu-kvm:6532 blocked for more than 600 seconds.
[ 4362.900053]       Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4362.909016] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4362.916895] qemu-kvm        D    0  6532   6515 0x00080080
[ 4362.922407] Call Trace:
[ 4362.924877]  __schedule+0x372/0x910
[ 4362.928390]  schedule+0x3c/0xe0
[ 4362.931543]  rt_spin_lock_slowlock_locked+0x10e/0x2b0
[ 4362.936622]  rt_spin_lock_slowlock+0x50/0x80
[ 4362.940903]  hrtimer_cancel_wait_running+0x3d/0x70
[ 4362.945711]  hrtimer_cancel+0x1f/0x30
[ 4362.949421]  __kvm_migrate_pit_timer+0x3c/0x80 [kvm]
[ 4362.954422]  __kvm_migrate_timers+0x16/0x30 [kvm]
[ 4362.959162]  vcpu_enter_guest+0x978/0x1950 [kvm]
[ 4362.963801]  ? ttwu_do_wakeup+0x53/0x190
[ 4362.967733]  ? _raw_spin_unlock_irqrestore+0x20/0x60
[ 4362.972731]  kvm_arch_vcpu_ioctl_run+0xfa/0x560 [kvm]
[ 4362.977807]  kvm_vcpu_ioctl+0x22a/0x630 [kvm]
[ 4362.982190]  ? do_futex+0xc4/0x630
[ 4362.985621]  do_vfs_ioctl+0xa4/0x640
[ 4362.989209]  ksys_ioctl+0x60/0x90
[ 4362.992539]  __x64_sys_ioctl+0x16/0x20
[ 4362.996299]  do_syscall_64+0x87/0x1a0
[ 4362.999976]  entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4363.005053] RIP: 0033:0x7fd4984a888b
[ 4363.008640] Code: Bad RIP value.
[ 4363.011881] RSP: 002b:00007fd48b37c618 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 4363.019458] RAX: ffffffffffffffda RBX: 0000564fef5d1c30 RCX: 00007fd4984a888b
[ 4363.026624] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000019
[ 4363.033763] RBP: 0000000000000000 R08: 0000564fecb5b7f0 R09: 00000001f0988900
[ 4363.040923] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000001
[ 4363.048073] R13: 0000564fecb2c3e0 R14: 0000000000000000 R15: 00007fd49d7df000
[ 4363.055233] INFO: task sudo:6553 blocked for more than 600 seconds.
[ 4363.061505]       Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4363.070502] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4363.078362] sudo            D    0  6553   6150 0x00080080
[ 4363.083884] Call Trace:
[ 4363.086346]  __schedule+0x372/0x910
[ 4363.089847]  ? _raw_spin_lock+0x13/0x40
[ 4363.093712]  schedule+0x3c/0xe0
[ 4363.096877]  rt_spin_lock_slowlock_locked+0x10e/0x2b0
[ 4363.101937]  rt_spin_lock_slowlock+0x50/0x80
[ 4363.106231]  ? preempt_count_add+0x49/0xa0
[ 4363.110336]  __local_bh_disable_ip+0x7f/0xa0
[ 4363.114626]  unix_create1+0x1dc/0x210
[ 4363.118308]  unix_create+0x37/0x70
[ 4363.121724]  __sock_create+0x102/0x1b0
[ 4363.125504]  __sys_socket+0x57/0xe0
[ 4363.129012]  __x64_sys_socket+0x16/0x20
[ 4363.132859]  do_syscall_64+0x87/0x1a0
[ 4363.136535]  entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4363.141594] RIP: 0033:0x7ff2b82645ab
[ 4363.145185] Code: Bad RIP value.
[ 4363.148428] RSP: 002b:00007ffe295ac158 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
[ 4363.156015] RAX: ffffffffffffffda RBX: 00005585d5f321c0 RCX: 00007ff2b82645ab
[ 4363.163192] RDX: 0000000000000000 RSI: 0000000000080801 RDI: 0000000000000001
[ 4363.170358] RBP: 0000000000000002 R08: 00005585d5f19016 R09: 0000000000000000
[ 4363.177504] R10: 0000000000000000 R11: 0000000000000246 R12: 00005585d5f322b0
[ 4363.184670] R13: 00005585d5f32980 R14: 000000000000001d R15: 00007ff2b6033312
[ 4379.006572] restraintd[2664]: *** Current Time: Fri Mar 05 06:22:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4439.006748] restraintd[2664]: *** Current Time: Fri Mar 05 06:23:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4499.005891] restraintd[2664]: *** Current Time: Fri Mar 05 06:24:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4524.854984] rcu: INFO: rcu_preempt self-detected stall on CPU
[ 4524.854987] rcu: 	5-....: (1859403 ticks this GP) idle=00e/1/0x4000000000000002 softirq=0/0 fqs=465007 
[ 4524.854987] 	(t=1860030 jiffies g=149877 q=62396)
[ 4524.854987] NMI backtrace for cpu 5
[ 4524.854987] CPU: 5 PID: 6534 Comm: qemu-kvm Kdump: loaded Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4524.854987] Hardware name: Dell Inc. PowerEdge R740/0DY2X0, BIOS 2.8.2 08/27/2020
[ 4524.854987] Call Trace:
[ 4524.854987]  <IRQ>
[ 4524.854987]  dump_stack+0x5c/0x80
[ 4524.854987]  nmi_cpu_backtrace.cold.4+0x13/0x4e
[ 4524.854987]  nmi_trigger_cpumask_backtrace+0x116/0x129
[ 4524.854987]  rcu_dump_cpu_stacks+0x9c/0xca
[ 4524.854987]  rcu_sched_clock_irq.cold.63+0x17c/0x508
[ 4524.854987]  ? tick_sched_do_timer+0x70/0x70
[ 4524.854987]  update_process_times+0x24/0x60
[ 4524.854987]  tick_sched_handle+0x22/0x60
[ 4524.854987]  tick_sched_timer+0x43/0x80
[ 4524.854987]  __hrtimer_run_queues+0x11d/0x3b0
[ 4524.854987]  hrtimer_interrupt+0x10a/0x220
[ 4524.854987]  ? rto_push_irq_work_func+0xbb/0x130
[ 4524.854987]  smp_apic_timer_interrupt+0x9d/0x220
[ 4524.854987]  apic_timer_interrupt+0xf/0x20
[ 4524.854987]  </IRQ>
[ 4524.854987] RIP: 0010:handle_external_interrupt_irqoff+0x80/0x110 [kvm_intel]
[ 4524.854987] Code: 10 48 c1 e0 20 48 09 c3 0f b7 06 48 09 c3 e8 57 c8 11 f2 65 48 89 2d 07 12 30 3f 48 89 e0 48 83 e4 f0 6a 18 50 9c 6a 10 ff d3 <90> 90
[ 4524.854987] RSP: 0018:ffffb92ece00fd08 EFLAGS: 00000086 ORIG_RAX: ffffffffffffff13
[ 4524.854987] RAX: ffffb92ece00fd08 RBX: ffffffffb3401b90 RCX: 00001b131e60b0b8
[ 4524.854987] RDX: 0000000080000000 RSI: ffffffffc0d51d34 RDI: ffffffffb3ae1e0e
[ 4524.854987] RBP: ffff972d3b068000 R08: 0000000055555554 R09: 0000000000000000
[ 4524.854987] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[ 4524.854987] R13: 0000000000000000 R14: ffff972d3b068038 R15: ffff9726cee8a700
[ 4524.854987]  ? __irqentry_text_start+0x8/0x8
[ 4524.854987]  ? handle_external_interrupt_irqoff+0x69/0x110 [kvm_intel]
[ 4524.854987]  ? vcpu_enter_guest+0x24d/0x1950 [kvm]
[ 4524.854987]  ? kvm_get_running_vcpu+0x2e/0x70 [kvm]
[ 4524.854987]  ? vmx_deliver_posted_interrupt+0x6f/0x110 [kvm_intel]
[ 4524.854987]  ? __apic_accept_irq+0x19c/0x340 [kvm]
[ 4524.854987]  ? kvm_arch_vcpu_ioctl_run+0xfa/0x560 [kvm]
[ 4524.854987]  ? kvm_vcpu_ioctl+0x22a/0x630 [kvm]
[ 4524.854987]  ? apic_timer_interrupt+0xa/0x20
[ 4524.854987]  ? do_vfs_ioctl+0xa4/0x640
[ 4524.854987]  ? ksys_ioctl+0x60/0x90
[ 4524.854987]  ? __x64_sys_ioctl+0x16/0x20
[ 4524.854987]  ? do_syscall_64+0x87/0x1a0
[ 4524.854987]  ? entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4559.005578] restraintd[2664]: *** Current Time: Fri Mar 05 06:25:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4619.006177] restraintd[2664]: *** Current Time: Fri Mar 05 06:26:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4679.005883] restraintd[2664]: *** Current Time: Fri Mar 05 06:27:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4704.857984] rcu: INFO: rcu_preempt self-detected stall on CPU
[ 4704.857985] rcu: 	5-....: (2039406 ticks this GP) idle=00e/1/0x4000000000000002 softirq=0/0 fqs=510008 
[ 4704.857985] 	(t=2040033 jiffies g=149877 q=67179)
[ 4704.857985] NMI backtrace for cpu 5
[ 4704.857985] CPU: 5 PID: 6534 Comm: qemu-kvm Kdump: loaded Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4704.857985] Hardware name: Dell Inc. PowerEdge R740/0DY2X0, BIOS 2.8.2 08/27/2020
[ 4704.857985] Call Trace:
[ 4704.857985]  <IRQ>
[ 4704.857985]  dump_stack+0x5c/0x80
[ 4704.857985]  nmi_cpu_backtrace.cold.4+0x13/0x4e
[ 4704.857985]  nmi_trigger_cpumask_backtrace+0x116/0x129
[ 4704.857985]  rcu_dump_cpu_stacks+0x9c/0xca
[ 4704.857985]  rcu_sched_clock_irq.cold.63+0x17c/0x508
[ 4704.857985]  ? tick_sched_do_timer+0x70/0x70
[ 4704.857985]  update_process_times+0x24/0x60
[ 4704.857985]  tick_sched_handle+0x22/0x60
[ 4704.857985]  tick_sched_timer+0x43/0x80
[ 4704.857985]  __hrtimer_run_queues+0x11d/0x3b0
[ 4704.857985]  hrtimer_interrupt+0x10a/0x220
[ 4704.857985]  ? rto_push_irq_work_func+0xbb/0x130
[ 4704.857985]  smp_apic_timer_interrupt+0x9d/0x220
[ 4704.857985]  apic_timer_interrupt+0xf/0x20
[ 4704.857985]  </IRQ>
[ 4704.857985] RIP: 0010:handle_external_interrupt_irqoff+0x80/0x110 [kvm_intel]
[ 4704.857985] Code: 10 48 c1 e0 20 48 09 c3 0f b7 06 48 09 c3 e8 57 c8 11 f2 65 48 89 2d 07 12 30 3f 48 89 e0 48 83 e4 f0 6a 18 50 9c 6a 10 ff d3 <90> 90
[ 4704.857985] RSP: 0018:ffffb92ece00fd08 EFLAGS: 00000086 ORIG_RAX: ffffffffffffff13
[ 4704.857985] RAX: ffffb92ece00fd08 RBX: ffffffffb3401b90 RCX: 00001b77781a1b18
[ 4704.857985] RDX: 0000000080000000 RSI: ffffffffc0d51d34 RDI: ffffffffb3ae1e0e
[ 4704.857985] RBP: ffff972d3b068000 R08: 0000000055555554 R09: 0000000000000000
[ 4704.857985] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[ 4704.857985] R13: 0000000000000000 R14: ffff972d3b068038 R15: ffff9726cee8a700
[ 4704.857985]  ? __irqentry_text_start+0x8/0x8
[ 4704.857985]  ? handle_external_interrupt_irqoff+0x69/0x110 [kvm_intel]
[ 4704.857985]  ? vcpu_enter_guest+0x24d/0x1950 [kvm]
[ 4704.857985]  ? kvm_get_running_vcpu+0x2e/0x70 [kvm]
[ 4704.857985]  ? vmx_deliver_posted_interrupt+0x6f/0x110 [kvm_intel]
[ 4704.857985]  ? __apic_accept_irq+0x19c/0x340 [kvm]
[ 4704.857985]  ? kvm_arch_vcpu_ioctl_run+0xfa/0x560 [kvm]
[ 4704.857985]  ? kvm_vcpu_ioctl+0x22a/0x630 [kvm]
[ 4704.857985]  ? apic_timer_interrupt+0xa/0x20
[ 4704.857985]  ? do_vfs_ioctl+0xa4/0x640
[ 4704.857985]  ? ksys_ioctl+0x60/0x90
[ 4704.857985]  ? __x64_sys_ioctl+0x16/0x20
[ 4704.857985]  ? do_syscall_64+0x87/0x1a0
[ 4704.857985]  ? entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4739.005584] restraintd[2664]: *** Current Time: Fri Mar 05 06:28:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4799.005796] restraintd[2664]: *** Current Time: Fri Mar 05 06:29:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4859.006367] restraintd[2664]: *** Current Time: Fri Mar 05 06:30:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4884.860985] rcu: INFO: rcu_preempt self-detected stall on CPU
[ 4884.860985] rcu: 	5-....: (2219409 ticks this GP) idle=00e/1/0x4000000000000002 softirq=0/0 fqs=555008 
[ 4884.860985] 	(t=2220036 jiffies g=149877 q=72629)
[ 4884.860985] NMI backtrace for cpu 5
[ 4884.860985] CPU: 5 PID: 6534 Comm: qemu-kvm Kdump: loaded Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4884.860985] Hardware name: Dell Inc. PowerEdge R740/0DY2X0, BIOS 2.8.2 08/27/2020
[ 4884.860985] Call Trace:
[ 4884.860985]  <IRQ>
[ 4884.860985]  dump_stack+0x5c/0x80
[ 4884.860985]  nmi_cpu_backtrace.cold.4+0x13/0x4e
[ 4884.860985]  nmi_trigger_cpumask_backtrace+0x116/0x129
[ 4884.860985]  rcu_dump_cpu_stacks+0x9c/0xca
[ 4884.860985]  rcu_sched_clock_irq.cold.63+0x17c/0x508
[ 4884.860985]  ? tick_sched_do_timer+0x70/0x70
[ 4884.860985]  update_process_times+0x24/0x60
[ 4884.860985]  tick_sched_handle+0x22/0x60
[ 4884.860985]  tick_sched_timer+0x43/0x80
[ 4884.860985]  __hrtimer_run_queues+0x11d/0x3b0
[ 4884.860985]  hrtimer_interrupt+0x10a/0x220
[ 4884.860985]  ? rto_push_irq_work_func+0xbb/0x130
[ 4884.860985]  smp_apic_timer_interrupt+0x9d/0x220
[ 4884.860985]  apic_timer_interrupt+0xf/0x20
[ 4884.860985]  </IRQ>
[ 4884.860985] RIP: 0010:handle_external_interrupt_irqoff+0x80/0x110 [kvm_intel]
[ 4884.860985] Code: 10 48 c1 e0 20 48 09 c3 0f b7 06 48 09 c3 e8 57 c8 11 f2 65 48 89 2d 07 12 30 3f 48 89 e0 48 83 e4 f0 6a 18 50 9c 6a 10 ff d3 <90> 90
[ 4884.860985] RSP: 0018:ffffb92ece00fd08 EFLAGS: 00000086 ORIG_RAX: ffffffffffffff13
[ 4884.860985] RAX: ffffb92ece00fd08 RBX: ffffffffb3401b90 RCX: 00001bdbd1d498c4
[ 4884.860985] RDX: 0000000080000000 RSI: ffffffffc0d51d34 RDI: ffffffffb3ae1e0e
[ 4884.860985] RBP: ffff972d3b068000 R08: 0000000055555554 R09: 0000000000000000
[ 4884.860985] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[ 4884.860985] R13: 0000000000000000 R14: ffff972d3b068038 R15: ffff9726cee8a700
[ 4884.860985]  ? __irqentry_text_start+0x8/0x8
[ 4884.860985]  ? handle_external_interrupt_irqoff+0x69/0x110 [kvm_intel]
[ 4884.860985]  ? vcpu_enter_guest+0x24d/0x1950 [kvm]
[ 4884.860985]  ? kvm_get_running_vcpu+0x2e/0x70 [kvm]
[ 4884.860985]  ? vmx_deliver_posted_interrupt+0x6f/0x110 [kvm_intel]
[ 4884.860985]  ? __apic_accept_irq+0x19c/0x340 [kvm]
[ 4884.860985]  ? kvm_check_async_pf_completion+0x25/0x110 [kvm]
[ 4884.860985]  ? kvm_arch_vcpu_ioctl_run+0xfa/0x560 [kvm]
[ 4884.860985]  ? kvm_vcpu_ioctl+0x22a/0x630 [kvm]
[ 4884.860985]  ? apic_timer_interrupt+0xa/0x20
[ 4884.860985]  ? do_vfs_ioctl+0xa4/0x640
[ 4884.860985]  ? ksys_ioctl+0x60/0x90
[ 4884.860985]  ? __x64_sys_ioctl+0x16/0x20
[ 4884.860985]  ? do_syscall_64+0x87/0x1a0
[ 4884.860985]  ? entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4919.006043] restraintd[2664]: *** Current Time: Fri Mar 05 06:31:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4979.006284] restraintd[2664]: *** Current Time: Fri Mar 05 06:32:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 4985.351512] INFO: task systemd-udevd:1424 blocked for more than 600 seconds.
[ 4985.358594]       Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4985.367585] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4985.375447] systemd-udevd   D    0  1424      1 0x00080324
[ 4985.380943] Call Trace:
[ 4985.383407]  __schedule+0x372/0x910
[ 4985.386906]  ? _raw_spin_lock_irq+0x1a/0x40
[ 4985.391110]  schedule+0x3c/0xe0
[ 4985.394280]  rt_spin_lock_slowlock_locked+0x10e/0x2b0
[ 4985.399368]  rt_spin_lock_slowlock+0x50/0x80
[ 4985.403678]  __local_bh_disable_ip+0x7f/0xa0
[ 4985.407966]  unix_create1+0x1dc/0x210
[ 4985.411640]  unix_create+0x37/0x70
[ 4985.415067]  __sock_create+0x102/0x1b0
[ 4985.418853]  __sys_socket+0x57/0xe0
[ 4985.422361]  __x64_sys_socket+0x16/0x20
[ 4985.426211]  do_syscall_64+0x87/0x1a0
[ 4985.429883]  entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4985.434944] RIP: 0033:0x7f01d05f05ab
[ 4985.438536] Code: Bad RIP value.
[ 4985.441774] RSP: 002b:00007ffefbdfe388 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
[ 4985.449356] RAX: ffffffffffffffda RBX: 00007f01d151a53b RCX: 00007f01d05f05ab
[ 4985.456497] RDX: 0000000000000000 RSI: 0000000000080002 RDI: 0000000000000001
[ 4985.463675] RBP: 00007ffefbdfe4c0 R08: 0000000000000000 R09: 0000000000000004
[ 4985.470841] R10: 0098cef393544260 R11: 0000000000000246 R12: 000000000000000b
[ 4985.478023] R13: 00007ffefbdfe580 R14: 00007ffefbdfe400 R15: 0000000000000000
[ 4985.485213] INFO: task sshd:1860 blocked for more than 600 seconds.
[ 4985.491503]       Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4985.500499] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4985.508369] sshd            D    0  1860      1 0x00080080
[ 4985.513878] Call Trace:
[ 4985.516344]  __schedule+0x372/0x910
[ 4985.519844]  ? _raw_spin_lock+0x13/0x40
[ 4985.523708]  schedule+0x3c/0xe0
[ 4985.526863]  rt_spin_lock_slowlock_locked+0x10e/0x2b0
[ 4985.531936]  rt_spin_lock_slowlock+0x50/0x80
[ 4985.536233]  ? preempt_count_add+0x49/0xa0
[ 4985.540368]  __local_bh_disable_ip+0x7f/0xa0
[ 4985.544665]  lock_sock_nested+0x22/0x70
[ 4985.548513]  inet_csk_accept+0x2e/0x370
[ 4985.552364]  inet_accept+0x43/0x190
[ 4985.555891]  __sys_accept4_file+0x122/0x1e0
[ 4985.560110]  ? __dentry_kill+0x125/0x160
[ 4985.564062]  __sys_accept4+0x57/0x90
[ 4985.567668]  __x64_sys_accept+0x18/0x20
[ 4985.571533]  do_syscall_64+0x87/0x1a0
[ 4985.575205]  entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4985.580275] RIP: 0033:0x7f98aaf2cea8
[ 4985.583890] Code: Bad RIP value.
[ 4985.587147] RSP: 002b:00007fff1d297e08 EFLAGS: 00000246 ORIG_RAX: 000000000000002b
[ 4985.594758] RAX: ffffffffffffffda RBX: 00005595600196a0 RCX: 00007f98aaf2cea8
[ 4985.601932] RDX: 00007fff1d297e98 RSI: 00007fff1d297eb0 RDI: 0000000000000004
[ 4985.609114] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000559561ee3010
[ 4985.616287] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[ 4985.623445] R13: 00005595600196a0 R14: 0000559561f05370 R15: 0000559561f0c3f0
[ 4985.630604] INFO: task qemu-kvm:6532 blocked for more than 600 seconds.
[ 4985.637235]       Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4985.646194] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4985.654056] qemu-kvm        D    0  6532   6515 0x00080080
[ 4985.659549] Call Trace:
[ 4985.662021]  __schedule+0x372/0x910
[ 4985.665539]  schedule+0x3c/0xe0
[ 4985.668703]  rt_spin_lock_slowlock_locked+0x10e/0x2b0
[ 4985.673764]  rt_spin_lock_slowlock+0x50/0x80
[ 4985.678057]  hrtimer_cancel_wait_running+0x3d/0x70
[ 4985.682856]  hrtimer_cancel+0x1f/0x30
[ 4985.686560]  __kvm_migrate_pit_timer+0x3c/0x80 [kvm]
[ 4985.691547]  __kvm_migrate_timers+0x16/0x30 [kvm]
[ 4985.696297]  vcpu_enter_guest+0x978/0x1950 [kvm]
[ 4985.700935]  ? ttwu_do_wakeup+0x53/0x190
[ 4985.704888]  ? _raw_spin_unlock_irqrestore+0x20/0x60
[ 4985.709895]  kvm_arch_vcpu_ioctl_run+0xfa/0x560 [kvm]
[ 4985.714986]  kvm_vcpu_ioctl+0x22a/0x630 [kvm]
[ 4985.719369]  ? do_futex+0xc4/0x630
[ 4985.722799]  do_vfs_ioctl+0xa4/0x640
[ 4985.726399]  ksys_ioctl+0x60/0x90
[ 4985.729724]  __x64_sys_ioctl+0x16/0x20
[ 4985.733494]  do_syscall_64+0x87/0x1a0
[ 4985.737196]  entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4985.742286] RIP: 0033:0x7fd4984a888b
[ 4985.745888] Code: Bad RIP value.
[ 4985.749138] RSP: 002b:00007fd48b37c618 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 4985.756713] RAX: ffffffffffffffda RBX: 0000564fef5d1c30 RCX: 00007fd4984a888b
[ 4985.763855] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000019
[ 4985.771018] RBP: 0000000000000000 R08: 0000564fecb5b7f0 R09: 00000001f0988900
[ 4985.778198] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000001
[ 4985.785363] R13: 0000564fecb2c3e0 R14: 0000000000000000 R15: 00007fd49d7df000
[ 4985.792543] INFO: task sudo:6553 blocked for more than 600 seconds.
[ 4985.798840]       Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 4985.807845] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4985.815714] sudo            D    0  6553   6150 0x00080080
[ 4985.821227] Call Trace:
[ 4985.823690]  __schedule+0x372/0x910
[ 4985.827192]  ? _raw_spin_lock+0x13/0x40
[ 4985.831056]  schedule+0x3c/0xe0
[ 4985.834211]  rt_spin_lock_slowlock_locked+0x10e/0x2b0
[ 4985.839272]  rt_spin_lock_slowlock+0x50/0x80
[ 4985.843555]  ? preempt_count_add+0x49/0xa0
[ 4985.847672]  __local_bh_disable_ip+0x7f/0xa0
[ 4985.851970]  unix_create1+0x1dc/0x210
[ 4985.855641]  unix_create+0x37/0x70
[ 4985.859059]  __sock_create+0x102/0x1b0
[ 4985.862821]  __sys_socket+0x57/0xe0
[ 4985.866319]  __x64_sys_socket+0x16/0x20
[ 4985.870193]  do_syscall_64+0x87/0x1a0
[ 4985.873890]  entry_SYSCALL_64_after_hwframe+0x65/0xca
[ 4985.878946] RIP: 0033:0x7ff2b82645ab
[ 4985.882535] Code: Bad RIP value.
[ 4985.885774] RSP: 002b:00007ffe295ac158 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
[ 4985.893370] RAX: ffffffffffffffda RBX: 00005585d5f321c0 RCX: 00007ff2b82645ab
[ 4985.900543] RDX: 0000000000000000 RSI: 0000000000080801 RDI: 0000000000000001
[ 4985.907710] RBP: 0000000000000002 R08: 00005585d5f19016 R09: 0000000000000000
[ 4985.914886] R10: 0000000000000000 R11: 0000000000000246 R12: 00005585d5f322b0
[ 4985.922053] R13: 00005585d5f32980 R14: 000000000000001d R15: 00007ff2b6033312
[ 5039.005903] restraintd[2664]: *** Current Time: Fri Mar 05 06:33:08 2021  Localwatchdog at: Sat Mar 13 11:44:07 2021
[ 5064.863985] rcu: INFO: rcu_preempt self-detected stall on CPU
[ 5064.863985] rcu: 	5-....: (2399412 ticks this GP) idle=00e/1/0x4000000000000002 softirq=0/0 fqs=600009 
[ 5064.863985] 	(t=2400039 jiffies g=149877 q=78224)
[ 5064.863985] NMI backtrace for cpu 5
[ 5064.863985] CPU: 5 PID: 6534 Comm: qemu-kvm Kdump: loaded Tainted: G          I      --------- -  - 4.18.0-240.15.1.rt7.69.el8_3.x86_64 #1
[ 5064.863985] Hardware name: Dell Inc. PowerEdge R740/0DY2X0, BIOS 2.8.2 08/27/2020
[ 5064.863985] Call Trace:
[ 5064.863985]  <IRQ>
[ 5064.863985]  dump_stack+0x5c/0x80
[ 5064.863985]  nmi_cpu_backtrace.cold.4+0x13/0x4e
[ 5064.863985]  nmi_trigger_cpumask_backtrace+0x116/0x129
[ 5064.863985]  rcu_dump_cpu_stacks+0x9c/0xca
[ 5064.863985]  rcu_sched_clock_irq.cold.63+0x17c/0x508
[ 5064.863985]  ? tick_sched_do_timer+0x70/0x70
[ 5064.863985]  update_process_times+0x24/0x60
[ 5064.863985]  tick_sched_handle+0x22/0x60
[ 5064.863985]  tick_sched_timer+0x43/0x80
[ 5064.863985]  __hrtimer_run_queues+0x11d/0x3b0
[ 5064.863985]  hrtimer_interrupt+0x10a/0x220
[ 5064.863985]  ? rto_push_irq_work_func+0xbb/0x130
[ 5064.863985]  smp_apic_timer_interrupt+0x9d/0x220
[ 5064.863985]  apic_timer_interrupt+0xf/0x20
[ 5064.863985]  </IRQ>
[ 5064.863985] RIP: 0010:handle_external_interrupt_irqoff+0x80/0x110 [kvm_intel]
[ 5064.863985] Code: 10 48 c1 e0 20 48 09 c3 0f b7 06 48 09 c3 e8 57 c8 11 f2 65 48 89 2d 07 12 30 3f 48 89 e0 48 83 e4 f0 6a 18 50 9c 6a 10 ff d3 <90> 90
[ 5064.863985] RSP: 0018:ffffb92ece00fd08 EFLAGS: 00000086 ORIG_RAX: ffffffffffffff13
[ 5064.863985] RAX: ffffb92ece00fd08 RBX: ffffffffb3401b90 RCX: 00001c402b8f5b88
[ 5064.863985] RDX: 0000000080000000 RSI: ffffffffc0d51d34 RDI: ffffffffb3ae1e0e
[ 5064.863985] RBP: ffff972d3b068000 R08: 0000000055555554 R09: 0000000000000000
[ 5064.863985] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[ 5064.863985] R13: 0000000000000000 R14: ffff972d3b068038 R15: ffff9726cee8a700
[ 5064.863985]  ? __irqentry_text_start+0x8/0x8
[ 5064.863985]  ? handle_external_interrupt_irqoff+0x69/0x110 [kvm_intel]
[ 5064.863985]  ? vcpu_enter_guest+0x24d/0x1950 [kvm]
[ 5064.863985]  ? kvm_get_running_vcpu+0x2e/0x70 [kvm]
[ 5064.863985]  ? vmx_deliver_posted_interrupt+0x6f/0x110 [kvm_intel]
[ 5064.863985]  ? __apic_accept_irq+0x19c/0x340 [kvm]
[ 5064.863985]  ? kvm_check_async_pf_completion+0x3c/0x110 [kvm]
[ 5064.863985]  ? kvm_arch_vcpu_ioctl_run+0xfa/0x560 [kvm]
[ 5064.863985]  ? kvm_vcpu_ioctl+0x22a/0x630 [kvm]
[ 5064.863985]  ? apic_timer_interrupt+0xa/0x20
[ 5064.863985]  ? do_vfs_ioctl+0xa4/0x640
[ 5064.863985]  ? ksys_ioctl+0x60/0x90
[ 5064.863985]  ? __x64_sys_ioctl+0x16/0x20
[ 5064.863985]  ? do_syscall_64+0x87/0x1a0
[ 5064.863985]  ? entry_SYSCALL_64_after_hwframe+0x65/0xca


Expected results:

test can run soomthly.
Additional info:
hugepage setting:
# cat /proc/meminfo | grep -i huge
HugePages_Total:      48
HugePages_Free:       48
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:    1048576 kB
Hugetlb:        50331648 kB

cpu isolate:
# cat /etc/tuned/cpu-partitioning-variables.conf 
# Examples:
# isolated_cores=2,4-7
# isolated_cores=2-23
#
# To disable the kernel load balancing in certain isolated CPUs:
# no_balance_cores=5-10
isolated_cores=2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,44,46
isolate_managed_irq=Y

core test cmd:
cmd : sudo umount /dev/hugepages
cmd : sudo mount -t hugetlbfs nodev /dev/hugepages
cmd : rm -f -r /tmp/qemu0_share
cmd : rsync -a -r -l --exclude=.git/ --exclude=*.o /usr/share/dpdk/ /tmp/qemu0_share/DPDK
cmd : sudo modprobe vfio-pci
cmd : sudo rm -f /dev/vhost-net
cmd : sudo chmod a+x /dev/vfio
cmd : sudo chmod -R 666 /dev/vfio/
cmd : sudo driverctl -v set-override 0000:3b:00.0 vfio-pci
cmd : sudo driverctl -v set-override 0000:3b:00.1 vfio-pci
cmd : sudo mv /var/run/openvswitch /var/run/openvswitch.20210305_055300_3998
cmd : sudo mv /etc/openvswitch /etc/openvswitch.20210305_055300_3998
cmd : sudo mkdir -p /var/run/openvswitch/
cmd : sudo mkdir -p /etc/openvswitch/
cmd : sudo /usr/bin/ovsdb-tool create /etc/openvswitch/conf.db /usr/share/openvswitch/vswitch.ovsschema
cmd : sudo /usr/sbin/ovsdb-server --remote=punix:/var/run/openvswitch/db.sock --remote=db:Open_vSwitch,Open_vSwitch,manager_options --pidfile=/var/run/ope
nvswitch/ovsdb-server.pid --overwrite-pidfile
cmd : sudo /usr/bin/ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-init=true
cmd : sudo /usr/bin/ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-lcore-mask=0x1
cmd : sudo /usr/bin/ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-socket-mem=4096,4096
cmd : /bin/bash -c "sudo -E /usr/sbin/ovs-vswitchd --pidfile=/var/run/openvswitch/ovs-vswitchd.pid --overwrite-pidfile --log-file=/tmp/vswitchd.log"
cmd : sudo /usr/bin/ovs-vsctl --timeout 10 add-br br0 -- set bridge br0 datapath_type=netdev
cmd : sudo /usr/bin/ovs-vsctl --timeout 10 set Open_vSwitch . other_config:max-idle=30000
cmd : sudo /usr/bin/ovs-vsctl --timeout 10 set Open_vSwitch . other_config:pmd-cpu-mask=0x4000004000
cmd : sudo /usr/bin/ovs-vsctl --timeout 10 add-port br0 dpdk0 -- set Interface dpdk0 type=dpdk options:dpdk-devargs=0000:3b:00.0 options:n_rxq=1
cmd : sudo /usr/bin/ovs-vsctl --timeout 10 add-port br0 dpdk1 -- set Interface dpdk1 type=dpdk options:dpdk-devargs=0000:3b:00.1 options:n_rxq=1
cmd : sudo /usr/bin/ovs-vsctl --timeout 10 add-port br0 dpdkvhostuserclient0 -- set Interface dpdkvhostuserclient0 type=dpdkvhostuserclient -- set Interfa
ce dpdkvhostuserclient0 options:vhost-server-path=/var/run/openvswitch/dpdkvhostuserclient0
cmd : sudo /usr/bin/ovs-vsctl --timeout 10 add-port br0 dpdkvhostuserclient1 -- set Interface dpdkvhostuserclient1 type=dpdkvhostuserclient -- set Interfa
ce dpdkvhostuserclient1 options:vhost-server-path=/var/run/openvswitch/dpdkvhostuserclient1
cmd : sudo /usr/bin/ovs-ofctl -O OpenFlow13 --timeout 10 del-flows br0
cmd : sudo /usr/bin/ovs-ofctl -O OpenFlow13 --timeout 10 add-flow br0 idle_timeout=0,in_port=1,action=output:3
cmd : sudo /usr/bin/ovs-ofctl -O OpenFlow13 --timeout 10 add-flow br0 idle_timeout=0,in_port=3,action=output:1
cmd : sudo /usr/bin/ovs-ofctl -O OpenFlow13 --timeout 10 add-flow br0 idle_timeout=0,in_port=4,action=output:2
cmd : sudo /usr/bin/ovs-ofctl -O OpenFlow13 --timeout 10 add-flow br0 idle_timeout=0,in_port=2,action=output:4
cmd : /bin/bash -c "sudo -E taskset -c 3,5,7,9 /usr/libexec/qemu-kvm -m 8192 -machine q35 -smp 3,sockets=3,cores=1,threads=1 -cpu host,migratable=off -dri
ve if=ide,file=rhel8.3-vsperf-1Q-noviommu.qcow2 -boot c --enable-kvm -monitor unix:/tmp/vm0monitor,server,nowait -object memory-backend-file,id=mem,size=8
192M,mem-path=/dev/hugepages,share=on,prealloc=yes,host-nodes=0,policy=bind -numa node,cpus=0-2,nodeid=0,memdev=mem -nographic -vnc :0 -name Client0 -snap
shot -net none -no-reboot -chardev socket,id=char0,path=/var/run/openvswitch/dpdkvhostuserclient0,server -netdev type=vhost-user,id=net1,chardev=char0,vho
stforce,queues=1 -device virtio-net-pci,mac=00:00:00:00:00:01,netdev=net1,csum=off,mrg_rxbuf=off,gso=off,guest_tso4=off,guest_tso6=off,guest_ecn=off,rx_qu
eue_size=1024,mq=on,vectors=4 -chardev socket,id=char1,path=/var/run/openvswitch/dpdkvhostuserclient1,server -netdev type=vhost-user,id=net2,chardev=char1
,vhostforce,queues=1 -device virtio-net-pci,mac=00:00:00:00:00:02,netdev=net2,csum=off,mrg_rxbuf=off,gso=off,guest_tso4=off,guest_tso6=off,guest_ecn=off,r
x_queue_size=1024,mq=on,vectors=4"


Note You need to log in before you can comment on or make changes to this bug.