Bug 2025609

Summary: qemu segfault after the 2rd postcopy live migration with vhost-user [rhel-av 8.5.0.z]
Product: Red Hat Enterprise Linux Advanced Virtualization Reporter: RHEL Program Management Team <pgm-rhel-tools>
Component: qemu-kvmAssignee: Juan Quintela <quintela>
qemu-kvm sub component: Live Migration QA Contact: Pei Zhang <pezhang>
Status: CLOSED ERRATA Docs Contact:
Severity: high    
Priority: high CC: chayang, coli, dgilbert, jinzhao, jmaloy, juzhang, maxime.coquelin, mrezanin, peterx, pezhang, quintela, smitterl, virt-maint, yfu, ymankad
Version: 8.5Keywords: Triaged, ZStream
Target Milestone: rc   
Target Release: 8.5   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: qemu-kvm-6.0.0-33.module+el8.5.0+13514+2c386966.1 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 2024981 Environment:
Last Closed: 2022-01-11 16:02:21 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1981782, 2024981    
Bug Blocks: 1982224, 2021981    

Comment 1 John Ferlan 2021-11-23 20:18:56 UTC
Juan - here is the "official" z-stream bug.  I believe all you need to do is update the gitlab commit to list *this* bug number instead of bug 2021976.

I will close/duplicate that bug to here for "tracking" right after this assignment.

Comment 2 John Ferlan 2021-11-23 20:24:50 UTC
*** Bug 2021976 has been marked as a duplicate of this bug. ***

Comment 3 John Ferlan 2021-11-23 20:26:57 UTC
Adding RHEL bug 1981782 as a depends on since that's RHEL 8.6.0 bug from which we cloned to RHEL-AV bug 2024981 so that we could create the proper z-stream bug.

Comment 4 John Ferlan 2021-11-24 20:49:51 UTC
Can we get the qa_ack+ please, so that this can get release+?

Comment 6 Yanan Fu 2021-12-09 07:02:35 UTC
QE bot(pre verify): Set 'Verified:Tested,SanityOnly' as gating/tier1 test pass.

Comment 9 Pei Zhang 2021-12-15 01:34:56 UTC
Verified with qemu-kvm-6.0.0-33.module+el8.5.0+13514+2c386966.1.x86_64:

The post copy live migration with vhost-user 1Q/2Q/4Q all work well. No any issues found. 

Testcase: live_migration_nonrt_server_2Q_1G_iommu_ovs_postcopy
=======================Stream Rate: 1Mpps=========================
No Stream_Rate Downtime Totaltime Ping_Loss moongen_Loss
0 1Mpps 249 19904 1583 551343
1 1Mpps 256 19680 522 556296
2 1Mpps 261 20122 1010 559721
3 1Mpps 233 19739 460 507750
Max 1Mpps 261 20122 1583 559721
Min 1Mpps 233 19680 460 507750
Mean 1Mpps 249 19861 893 543777
Median 1Mpps 252 19821 766 553819
Stdev 0 12.21 198.0 521.19 24263.32


Testcase: live_migration_nonrt_server_4Q_1G_iommu_ovs_postcopy
=======================Stream Rate: 1Mpps=========================
No Stream_Rate Downtime Totaltime Ping_Loss moongen_Loss
0 1Mpps 306 21347 1683 896664
1 1Mpps 288 21798 1302 750727
2 1Mpps 283 21510 827 776352
3 1Mpps 282 21948 1327 732800
Max 1Mpps 306 21948 1683 896664
Min 1Mpps 282 21347 827 732800
Mean 1Mpps 289 21650 1284 789135
Median 1Mpps 285 21654 1314 763539
Stdev 0 11.18 272.1 351.29 73879.85


Testcase: live_migration_nonrt_server_1Q_1G_iommu_ovs_postcopy
=======================Stream Rate: 1Mpps=========================
No Stream_Rate Downtime Totaltime Ping_Loss moongen_Loss
0 1Mpps 261 18539 1892 568306
1 1Mpps 189 18034 537 424360
2 1Mpps 224 18747 1132 492561
3 1Mpps 194 18224 488 434677
Max 1Mpps 261 18747 1892 568306
Min 1Mpps 189 18034 488 424360
Mean 1Mpps 217 18386 1012 479976
Median 1Mpps 209 18381 834 463619
Stdev 0 33.15 318.26 655.49 66095.16


In the src and des hosts:
# dmesg | grep segfault
(empty)


So this bug has been fixed very well. Move to VERIFIED. Remove "SanityOnly".

Comment 11 errata-xmlrpc 2022-01-11 16:02:21 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Low: virt:av and virt-devel:av security and bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:0081