Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1578481

Summary: Failing qemu-iotests ppc64le rhev
Product: Red Hat Enterprise Linux 7 Reporter: Lukáš Doktor <ldoktor>
Component: qemu-kvm-rhevAssignee: Ademar Reis <areis>
Status: CLOSED DEFERRED QA Contact: Yihuang Yu <yihyu>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 7.6CC: juzhang, knoel, mdeng, micai, michen, qzhang, virt-maint, xianwang, xuma, yhong
Target Milestone: rc   
Target Release: ---   
Hardware: ppc64le   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-03-18 21:08:32 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
Avocado results of qemu-iotests. In "version" you can see the qemu/kernel version and the "qemu-iotests" contains qemu-iotests from the execution. none

Description Lukáš Doktor 2018-05-15 16:54:23 UTC
Created attachment 1436853 [details]
Avocado results of qemu-iotests. In "version" you can see the qemu/kernel version and the "qemu-iotests" contains qemu-iotests from the execution.

Description of problem:
There are many failing qemu-iotests, let's track them here.

Version-Release number of selected component (if applicable):
qemu-kvm-rhev-2.12.0-1.el7.ppc64le

How reproducible:
Always (with some fluctuation)

Steps to Reproduce:
1. Install qemu-kvm-rhev
2. Checkout the installed version git repo
3. ./configure
4. cd tests/qemu-iotests
5. ./check $TESTNAME_INCLUDING_ARGS

Actual results:
not ok 3 -nbd -raw 001;run-7449
not ok 4 -nbd -qcow2 001;run-7449
not ok 7 -nbd -raw 002;run-7449
not ok 8 -nbd -qcow2 002;run-7449
not ok 11 -nbd -raw 003;run-7449
not ok 12 -nbd -qcow2 003;run-7449
not ok 15 -nbd -raw 004;run-7449
not ok 16 -nbd -qcow2 004;run-7449
not ok 19 -nbd -raw 005;run-7449
not ok 20 -nbd -qcow2 005;run-7449
not ok 24 -nbd -qcow2 007;run-7449
not ok 27 -nbd -raw 008;run-7449
not ok 28 -nbd -qcow2 008;run-7449
not ok 31 -nbd -raw 009;run-7449
not ok 32 -nbd -qcow2 009;run-7449
not ok 35 -nbd -raw 010;run-7449
not ok 36 -nbd -qcow2 010;run-7449
not ok 39 -nbd -raw 011;run-7449
not ok 40 -nbd -qcow2 011;run-7449
not ok 56 -nbd -qcow2 015;run-7449
not ok 60 -nbd -qcow2 017;run-7449
not ok 75 -nbd -raw 021;run-7449
not ok 76 -nbd -qcow2 021;run-7449
not ok 80 -nbd -qcow2 022;run-7449
not ok 100 -nbd -qcow2 027;run-7449
not ok 102 -file -qcow2 028;run-7449
not ok 108 -nbd -qcow2 029;run-7449
not ok 110 -file -qcow2 030;run-7449
not ok 112 -nbd -qcow2 030;run-7449
not ok 119 -nbd -raw 032;run-7449
not ok 120 -nbd -qcow2 032;run-7449
not ok 123 -nbd -raw 033;run-7449
not ok 124 -nbd -qcow2 033;run-7449
not ok 132 -nbd -qcow2 035;run-7449
not ok 150 -file -qcow2 040;run-7449
not ok 152 -nbd -qcow2 040;run-7449
not ok 154 -file -qcow2 041;run-7449
not ok 156 -nbd -qcow2 041;run-7449
not ok 166 -file -qcow2 044;run-7449
not ok 168 -nbd -qcow2 044;run-7449
not ok 169 -file -raw 045;run-7449
not ok 171 -nbd -raw 045;run-7449
not ok 180 -nbd -qcow2 047;run-7449
not ok 209 -file -raw 055;run-7449
not ok 210 -file -qcow2 055;run-7449
not ok 211 -nbd -raw 055;run-7449
not ok 212 -nbd -qcow2 055;run-7449
not ok 214 -file -qcow2 056;run-7449
not ok 216 -nbd -qcow2 056;run-7449
not ok 240 -nbd -qcow2 062;run-7449
not ok 256 -nbd -qcow2 066;run-7449
not ok 264 -nbd -qcow2 068;run-7449
not ok 284 -nbd -qcow2 073;run-7449
not ok 299 -nbd -raw 077;run-7449
not ok 313 -file -raw 081;run-7449
not ok 324 -nbd -qcow2 083;run-7449
not ok 330 -file -qcow2 085;run-7449
not ok 361 -file -raw 093;run-7449
not ok 363 -nbd -raw 093;run-7449
not ok 367 -nbd -raw 094;run-7449
not ok 368 -nbd -qcow2 094;run-7449
not ok 370 -file -qcow2 095;run-7449
not ok 374 -file -qcow2 096;run-7449
not ok 376 -nbd -qcow2 096;run-7449
not ok 403 -nbd -raw 104;run-7449
not ok 404 -nbd -qcow2 104;run-7449
not ok 408 -nbd -qcow2 105;run-7449
not ok 421 -file -raw 109;run-7449
not ok 444 -nbd -qcow2 114;run-7449
not ok 446 -file -qcow2 115;run-7449
not ok 463 -nbd -raw 119;run-7449
not ok 479 -nbd -raw 123;run-7449
not ok 482 -file -qcow2 124;run-7449
not ok 484 -nbd -qcow2 124;run-7449
not ok 486 -file -qcow2 125;run-7449
not ok 494 -file -qcow2 127;run-7449
not ok 502 -file -qcow2 129;run-7449
not ok 504 -nbd -qcow2 129;run-7449
not ok 508 -nbd -qcow2 130;run-7449
not ok 513 -file -raw 132;run-7449
not ok 514 -file -qcow2 132;run-7449
not ok 515 -nbd -raw 132;run-7449
not ok 516 -nbd -qcow2 132;run-7449
not ok 524 -nbd -qcow2 134;run-7449
not ok 529 -file -raw 136;run-7449
not ok 531 -nbd -raw 136;run-7449
not ok 538 -file -qcow2 138;run-7449
not ok 542 -file -qcow2 139;run-7449
not ok 544 -nbd -qcow2 139;run-7449
not ok 550 -file -qcow2 141;run-7449
not ok 554 -file -qcow2 142;run-7449
not ok 562 -file -qcow2 144;run-7449
not ok 567 -nbd -raw 145;run-7449
not ok 568 -nbd -qcow2 145;run-7449
not ok 573 -file -raw 147;run-7449
not ok 574 -file -qcow2 147;run-7449
not ok 575 -nbd -raw 147;run-7449
not ok 576 -nbd -qcow2 147;run-7449
not ok 577 -file -raw 148;run-7449
not ok 579 -nbd -raw 148;run-7449
not ok 589 -file -raw 152;run-7449
not ok 590 -file -qcow2 152;run-7449
not ok 591 -nbd -raw 152;run-7449
not ok 592 -nbd -qcow2 152;run-7449
not ok 602 -file -qcow2 155;run-7449
not ok 604 -nbd -qcow2 155;run-7449
not ok 606 -file -qcow2 156;run-7449
not ok 608 -nbd -qcow2 156;run-7449
not ok 616 -nbd -qcow2 158;run-7449
not ok 660 -nbd -qcow2 174;run-7449
not ok 683 -nbd -raw 181;run-7449
not ok 684 -nbd -qcow2 181;run-7449
not ok 693 -file -raw 184;run-7449
not ok 694 -file -qcow2 184;run-7449
not ok 695 -nbd -raw 184;run-7449
not ok 696 -nbd -qcow2 184;run-7449
not ok 698 -file -qcow2 185;run-7449
not ok 712 -nbd -qcow2 188;run-7449
not ok 716 -nbd -qcow2 189;run-7449
not ok 722 -file -qcow2 191;run-7449
not ok 729 -file -raw 194;run-7449
not ok 730 -file -qcow2 194;run-7449
not ok 731 -nbd -raw 194;run-7449
not ok 732 -nbd -qcow2 194;run-7449
not ok 741 -file -raw 197;run-7449
not ok 742 -file -qcow2 197;run-7449
not ok 743 -nbd -raw 197;run-7449
not ok 744 -nbd -qcow2 197;run-7449
not ok 748 -nbd -qcow2 198;run-7449
not ok 760 -nbd -qcow2 201;run-7449
not ok 785 -file -raw 208;run-7449
not ok 786 -file -qcow2 208;run-7449
not ok 787 -nbd -raw 208;run-7449
not ok 788 -nbd -qcow2 208;run-7449
not ok 809 -vmdk 059;run-7449
not ok 815 -vdi 084;run-7449

Expected results:
all should PASS (or be skipped)

Additional info:
Tests were executed via Avocado, results are attached, but it's reproducible directly by "./check $testname" where testname is in format "not ok \d+ ([^;]+);.*" (basically there is "not ok" string, followed by serial id which you should ignore as well as everything after the last ";". So the last "not ok 733 -vmdk 059;run-7449" => "./check -vmdk 059")

Comment 2 Lukáš Doktor 2018-05-15 17:06:55 UTC
Note there were some left-behind processes after the execution, usually test 077 and some nbd processes. Repeating the execution usually increases the number of failed tests.

Also it's worth mentioning you can diff the attached results via "avocado diff $RESULTS1 $RESULTS2". Diff to (slightly different version of qemu) from https://bugzilla.redhat.com/show_bug.cgi?id=1578483 is:

- ppc64le (qemu-kvm-rhev)
+ x86_64 (qemu-kvm-rhev)
--file -qcow2 028;run-7449: FAIL
+-file -qcow2 028;run-7449: PASS
--file -qcow2 040;run-7449: FAIL
+-file -qcow2 040;run-7449: PASS
--nbd -qcow2 040;run-7449: FAIL
+-nbd -qcow2 040;run-7449: PASS
--file -qcow2 044;run-7449: FAIL
+-file -qcow2 044;run-7449: PASS
--nbd -qcow2 044;run-7449: FAIL
+-nbd -qcow2 044;run-7449: PASS
--file -qcow2 051;run-7449: PASS
+-file -qcow2 051;run-7449: FAIL
--file -qcow2 056;run-7449: FAIL
+-file -qcow2 056;run-7449: PASS
--nbd -qcow2 056;run-7449: FAIL
+-nbd -qcow2 056;run-7449: PASS
--file -qcow2 085;run-7449: FAIL
+-file -qcow2 085;run-7449: PASS
--file -qcow2 095;run-7449: FAIL
+-file -qcow2 095;run-7449: PASS
--file -qcow2 096;run-7449: FAIL
+-file -qcow2 096;run-7449: PASS
--nbd -qcow2 096;run-7449: FAIL
+-nbd -qcow2 096;run-7449: PASS
--file -raw 109;run-7449: FAIL
+-file -raw 109;run-7449: PASS
--file -raw 118;run-7449: WARN
--file -qcow2 118;run-7449: WARN
--nbd -raw 118;run-7449: WARN
--nbd -qcow2 118;run-7449: WARN
+-file -raw 118;run-7449: FAIL
+-file -qcow2 118;run-7449: FAIL
+-nbd -raw 118;run-7449: FAIL
+-nbd -qcow2 118;run-7449: FAIL
--file -qcow2 122;run-7449: PASS
+-file -qcow2 122;run-7449: FAIL
--file -qcow2 124;run-7449: FAIL
+-file -qcow2 124;run-7449: PASS
--nbd -qcow2 124;run-7449: FAIL
+-nbd -qcow2 124;run-7449: PASS
--file -qcow2 125;run-7449: FAIL
+-file -qcow2 125;run-7449: PASS
--file -qcow2 127;run-7449: FAIL
+-file -qcow2 127;run-7449: PASS
--file -qcow2 129;run-7449: FAIL
+-file -qcow2 129;run-7449: PASS
--nbd -qcow2 129;run-7449: FAIL
+-nbd -qcow2 129;run-7449: PASS
--file -raw 132;run-7449: FAIL
--file -qcow2 132;run-7449: FAIL
--nbd -raw 132;run-7449: FAIL
--nbd -qcow2 132;run-7449: FAIL
+-file -raw 132;run-7449: PASS
+-file -qcow2 132;run-7449: PASS
+-nbd -raw 132;run-7449: PASS
+-nbd -qcow2 132;run-7449: PASS
--file -qcow2 141;run-7449: FAIL
+-file -qcow2 141;run-7449: PASS
--file -qcow2 142;run-7449: FAIL
+-file -qcow2 142;run-7449: PASS
--file -qcow2 144;run-7449: FAIL
+-file -qcow2 144;run-7449: PASS
--file -raw 152;run-7449: FAIL
--file -qcow2 152;run-7449: FAIL
--nbd -raw 152;run-7449: FAIL
--nbd -qcow2 152;run-7449: FAIL
+-file -raw 152;run-7449: PASS
+-file -qcow2 152;run-7449: PASS
+-nbd -raw 152;run-7449: PASS
+-nbd -qcow2 152;run-7449: PASS
--file -qcow2 155;run-7449: FAIL
+-file -qcow2 155;run-7449: PASS
--nbd -qcow2 155;run-7449: FAIL
+-nbd -qcow2 155;run-7449: PASS
--file -qcow2 156;run-7449: FAIL
+-file -qcow2 156;run-7449: PASS
--file -qcow2 172;run-7449: WARN
+-file -qcow2 172;run-7449: FAIL
--file -qcow2 185;run-7449: FAIL
+-file -qcow2 185;run-7449: PASS
--file -qcow2 186;run-7449: WARN
+-file -qcow2 186;run-7449: FAIL
--file -qcow2 191;run-7449: FAIL
+-file -qcow2 191;run-7449: PASS
--file -raw 192;run-7449: WARN
--file -qcow2 192;run-7449: WARN
+-file -raw 192;run-7449: PASS
+-file -qcow2 192;run-7449: PASS
--file -raw 194;run-7449: FAIL
--file -qcow2 194;run-7449: FAIL
--nbd -raw 194;run-7449: FAIL
--nbd -qcow2 194;run-7449: FAIL
+-file -raw 194;run-7449: PASS
+-file -qcow2 194;run-7449: PASS
+-nbd -raw 194;run-7449: PASS
+-nbd -qcow2 194;run-7449: PASS
--file -raw 208;run-7449: FAIL
--file -qcow2 208;run-7449: FAIL
--nbd -raw 208;run-7449: FAIL
--nbd -qcow2 208;run-7449: FAIL
+-file -raw 208;run-7449: PASS
+-file -qcow2 208;run-7449: PASS
+-nbd -raw 208;run-7449: PASS
+-nbd -qcow2 208;run-7449: PASS

Comment 7 Ademar Reis 2019-03-18 21:08:32 UTC
Our downstream CI team is now running qemu-iotests. Several of them are even enabled in %check as part of rpmbuild.

The ones that are broken in the CI or brew environment are being reported in bugzilla (there are several reported already).

So I'm closing all of the old qemu-iotest BZs. We'll work on them in this more controlled environment of CI and brew.