Bug 1578481 - Failing qemu-iotests ppc64le rhev
Summary: Failing qemu-iotests ppc64le rhev
Keywords:
Status: CLOSED DEFERRED
Alias: None
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: qemu-kvm-rhev
Version: 7.6
Hardware: ppc64le
OS: Unspecified
unspecified
unspecified
Target Milestone: rc
: ---
Assignee: Ademar Reis
QA Contact: Yihuang Yu
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-05-15 16:54 UTC by Lukáš Doktor
Modified: 2019-03-18 21:08 UTC (History)
10 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-03-18 21:08:32 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
Avocado results of qemu-iotests. In "version" you can see the qemu/kernel version and the "qemu-iotests" contains qemu-iotests from the execution. (1.41 MB, application/x-bzip)
2018-05-15 16:54 UTC, Lukáš Doktor
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 1578479 0 unspecified CLOSED Failing qemu-iotests s390x 2021-02-22 00:41:40 UTC

Internal Links: 1578479

Description Lukáš Doktor 2018-05-15 16:54:23 UTC
Created attachment 1436853 [details]
Avocado results of qemu-iotests. In "version" you can see the qemu/kernel version and the "qemu-iotests" contains qemu-iotests from the execution.

Description of problem:
There are many failing qemu-iotests, let's track them here.

Version-Release number of selected component (if applicable):
qemu-kvm-rhev-2.12.0-1.el7.ppc64le

How reproducible:
Always (with some fluctuation)

Steps to Reproduce:
1. Install qemu-kvm-rhev
2. Checkout the installed version git repo
3. ./configure
4. cd tests/qemu-iotests
5. ./check $TESTNAME_INCLUDING_ARGS

Actual results:
not ok 3 -nbd -raw 001;run-7449
not ok 4 -nbd -qcow2 001;run-7449
not ok 7 -nbd -raw 002;run-7449
not ok 8 -nbd -qcow2 002;run-7449
not ok 11 -nbd -raw 003;run-7449
not ok 12 -nbd -qcow2 003;run-7449
not ok 15 -nbd -raw 004;run-7449
not ok 16 -nbd -qcow2 004;run-7449
not ok 19 -nbd -raw 005;run-7449
not ok 20 -nbd -qcow2 005;run-7449
not ok 24 -nbd -qcow2 007;run-7449
not ok 27 -nbd -raw 008;run-7449
not ok 28 -nbd -qcow2 008;run-7449
not ok 31 -nbd -raw 009;run-7449
not ok 32 -nbd -qcow2 009;run-7449
not ok 35 -nbd -raw 010;run-7449
not ok 36 -nbd -qcow2 010;run-7449
not ok 39 -nbd -raw 011;run-7449
not ok 40 -nbd -qcow2 011;run-7449
not ok 56 -nbd -qcow2 015;run-7449
not ok 60 -nbd -qcow2 017;run-7449
not ok 75 -nbd -raw 021;run-7449
not ok 76 -nbd -qcow2 021;run-7449
not ok 80 -nbd -qcow2 022;run-7449
not ok 100 -nbd -qcow2 027;run-7449
not ok 102 -file -qcow2 028;run-7449
not ok 108 -nbd -qcow2 029;run-7449
not ok 110 -file -qcow2 030;run-7449
not ok 112 -nbd -qcow2 030;run-7449
not ok 119 -nbd -raw 032;run-7449
not ok 120 -nbd -qcow2 032;run-7449
not ok 123 -nbd -raw 033;run-7449
not ok 124 -nbd -qcow2 033;run-7449
not ok 132 -nbd -qcow2 035;run-7449
not ok 150 -file -qcow2 040;run-7449
not ok 152 -nbd -qcow2 040;run-7449
not ok 154 -file -qcow2 041;run-7449
not ok 156 -nbd -qcow2 041;run-7449
not ok 166 -file -qcow2 044;run-7449
not ok 168 -nbd -qcow2 044;run-7449
not ok 169 -file -raw 045;run-7449
not ok 171 -nbd -raw 045;run-7449
not ok 180 -nbd -qcow2 047;run-7449
not ok 209 -file -raw 055;run-7449
not ok 210 -file -qcow2 055;run-7449
not ok 211 -nbd -raw 055;run-7449
not ok 212 -nbd -qcow2 055;run-7449
not ok 214 -file -qcow2 056;run-7449
not ok 216 -nbd -qcow2 056;run-7449
not ok 240 -nbd -qcow2 062;run-7449
not ok 256 -nbd -qcow2 066;run-7449
not ok 264 -nbd -qcow2 068;run-7449
not ok 284 -nbd -qcow2 073;run-7449
not ok 299 -nbd -raw 077;run-7449
not ok 313 -file -raw 081;run-7449
not ok 324 -nbd -qcow2 083;run-7449
not ok 330 -file -qcow2 085;run-7449
not ok 361 -file -raw 093;run-7449
not ok 363 -nbd -raw 093;run-7449
not ok 367 -nbd -raw 094;run-7449
not ok 368 -nbd -qcow2 094;run-7449
not ok 370 -file -qcow2 095;run-7449
not ok 374 -file -qcow2 096;run-7449
not ok 376 -nbd -qcow2 096;run-7449
not ok 403 -nbd -raw 104;run-7449
not ok 404 -nbd -qcow2 104;run-7449
not ok 408 -nbd -qcow2 105;run-7449
not ok 421 -file -raw 109;run-7449
not ok 444 -nbd -qcow2 114;run-7449
not ok 446 -file -qcow2 115;run-7449
not ok 463 -nbd -raw 119;run-7449
not ok 479 -nbd -raw 123;run-7449
not ok 482 -file -qcow2 124;run-7449
not ok 484 -nbd -qcow2 124;run-7449
not ok 486 -file -qcow2 125;run-7449
not ok 494 -file -qcow2 127;run-7449
not ok 502 -file -qcow2 129;run-7449
not ok 504 -nbd -qcow2 129;run-7449
not ok 508 -nbd -qcow2 130;run-7449
not ok 513 -file -raw 132;run-7449
not ok 514 -file -qcow2 132;run-7449
not ok 515 -nbd -raw 132;run-7449
not ok 516 -nbd -qcow2 132;run-7449
not ok 524 -nbd -qcow2 134;run-7449
not ok 529 -file -raw 136;run-7449
not ok 531 -nbd -raw 136;run-7449
not ok 538 -file -qcow2 138;run-7449
not ok 542 -file -qcow2 139;run-7449
not ok 544 -nbd -qcow2 139;run-7449
not ok 550 -file -qcow2 141;run-7449
not ok 554 -file -qcow2 142;run-7449
not ok 562 -file -qcow2 144;run-7449
not ok 567 -nbd -raw 145;run-7449
not ok 568 -nbd -qcow2 145;run-7449
not ok 573 -file -raw 147;run-7449
not ok 574 -file -qcow2 147;run-7449
not ok 575 -nbd -raw 147;run-7449
not ok 576 -nbd -qcow2 147;run-7449
not ok 577 -file -raw 148;run-7449
not ok 579 -nbd -raw 148;run-7449
not ok 589 -file -raw 152;run-7449
not ok 590 -file -qcow2 152;run-7449
not ok 591 -nbd -raw 152;run-7449
not ok 592 -nbd -qcow2 152;run-7449
not ok 602 -file -qcow2 155;run-7449
not ok 604 -nbd -qcow2 155;run-7449
not ok 606 -file -qcow2 156;run-7449
not ok 608 -nbd -qcow2 156;run-7449
not ok 616 -nbd -qcow2 158;run-7449
not ok 660 -nbd -qcow2 174;run-7449
not ok 683 -nbd -raw 181;run-7449
not ok 684 -nbd -qcow2 181;run-7449
not ok 693 -file -raw 184;run-7449
not ok 694 -file -qcow2 184;run-7449
not ok 695 -nbd -raw 184;run-7449
not ok 696 -nbd -qcow2 184;run-7449
not ok 698 -file -qcow2 185;run-7449
not ok 712 -nbd -qcow2 188;run-7449
not ok 716 -nbd -qcow2 189;run-7449
not ok 722 -file -qcow2 191;run-7449
not ok 729 -file -raw 194;run-7449
not ok 730 -file -qcow2 194;run-7449
not ok 731 -nbd -raw 194;run-7449
not ok 732 -nbd -qcow2 194;run-7449
not ok 741 -file -raw 197;run-7449
not ok 742 -file -qcow2 197;run-7449
not ok 743 -nbd -raw 197;run-7449
not ok 744 -nbd -qcow2 197;run-7449
not ok 748 -nbd -qcow2 198;run-7449
not ok 760 -nbd -qcow2 201;run-7449
not ok 785 -file -raw 208;run-7449
not ok 786 -file -qcow2 208;run-7449
not ok 787 -nbd -raw 208;run-7449
not ok 788 -nbd -qcow2 208;run-7449
not ok 809 -vmdk 059;run-7449
not ok 815 -vdi 084;run-7449

Expected results:
all should PASS (or be skipped)

Additional info:
Tests were executed via Avocado, results are attached, but it's reproducible directly by "./check $testname" where testname is in format "not ok \d+ ([^;]+);.*" (basically there is "not ok" string, followed by serial id which you should ignore as well as everything after the last ";". So the last "not ok 733 -vmdk 059;run-7449" => "./check -vmdk 059")

Comment 2 Lukáš Doktor 2018-05-15 17:06:55 UTC
Note there were some left-behind processes after the execution, usually test 077 and some nbd processes. Repeating the execution usually increases the number of failed tests.

Also it's worth mentioning you can diff the attached results via "avocado diff $RESULTS1 $RESULTS2". Diff to (slightly different version of qemu) from https://bugzilla.redhat.com/show_bug.cgi?id=1578483 is:

- ppc64le (qemu-kvm-rhev)
+ x86_64 (qemu-kvm-rhev)
--file -qcow2 028;run-7449: FAIL
+-file -qcow2 028;run-7449: PASS
--file -qcow2 040;run-7449: FAIL
+-file -qcow2 040;run-7449: PASS
--nbd -qcow2 040;run-7449: FAIL
+-nbd -qcow2 040;run-7449: PASS
--file -qcow2 044;run-7449: FAIL
+-file -qcow2 044;run-7449: PASS
--nbd -qcow2 044;run-7449: FAIL
+-nbd -qcow2 044;run-7449: PASS
--file -qcow2 051;run-7449: PASS
+-file -qcow2 051;run-7449: FAIL
--file -qcow2 056;run-7449: FAIL
+-file -qcow2 056;run-7449: PASS
--nbd -qcow2 056;run-7449: FAIL
+-nbd -qcow2 056;run-7449: PASS
--file -qcow2 085;run-7449: FAIL
+-file -qcow2 085;run-7449: PASS
--file -qcow2 095;run-7449: FAIL
+-file -qcow2 095;run-7449: PASS
--file -qcow2 096;run-7449: FAIL
+-file -qcow2 096;run-7449: PASS
--nbd -qcow2 096;run-7449: FAIL
+-nbd -qcow2 096;run-7449: PASS
--file -raw 109;run-7449: FAIL
+-file -raw 109;run-7449: PASS
--file -raw 118;run-7449: WARN
--file -qcow2 118;run-7449: WARN
--nbd -raw 118;run-7449: WARN
--nbd -qcow2 118;run-7449: WARN
+-file -raw 118;run-7449: FAIL
+-file -qcow2 118;run-7449: FAIL
+-nbd -raw 118;run-7449: FAIL
+-nbd -qcow2 118;run-7449: FAIL
--file -qcow2 122;run-7449: PASS
+-file -qcow2 122;run-7449: FAIL
--file -qcow2 124;run-7449: FAIL
+-file -qcow2 124;run-7449: PASS
--nbd -qcow2 124;run-7449: FAIL
+-nbd -qcow2 124;run-7449: PASS
--file -qcow2 125;run-7449: FAIL
+-file -qcow2 125;run-7449: PASS
--file -qcow2 127;run-7449: FAIL
+-file -qcow2 127;run-7449: PASS
--file -qcow2 129;run-7449: FAIL
+-file -qcow2 129;run-7449: PASS
--nbd -qcow2 129;run-7449: FAIL
+-nbd -qcow2 129;run-7449: PASS
--file -raw 132;run-7449: FAIL
--file -qcow2 132;run-7449: FAIL
--nbd -raw 132;run-7449: FAIL
--nbd -qcow2 132;run-7449: FAIL
+-file -raw 132;run-7449: PASS
+-file -qcow2 132;run-7449: PASS
+-nbd -raw 132;run-7449: PASS
+-nbd -qcow2 132;run-7449: PASS
--file -qcow2 141;run-7449: FAIL
+-file -qcow2 141;run-7449: PASS
--file -qcow2 142;run-7449: FAIL
+-file -qcow2 142;run-7449: PASS
--file -qcow2 144;run-7449: FAIL
+-file -qcow2 144;run-7449: PASS
--file -raw 152;run-7449: FAIL
--file -qcow2 152;run-7449: FAIL
--nbd -raw 152;run-7449: FAIL
--nbd -qcow2 152;run-7449: FAIL
+-file -raw 152;run-7449: PASS
+-file -qcow2 152;run-7449: PASS
+-nbd -raw 152;run-7449: PASS
+-nbd -qcow2 152;run-7449: PASS
--file -qcow2 155;run-7449: FAIL
+-file -qcow2 155;run-7449: PASS
--nbd -qcow2 155;run-7449: FAIL
+-nbd -qcow2 155;run-7449: PASS
--file -qcow2 156;run-7449: FAIL
+-file -qcow2 156;run-7449: PASS
--file -qcow2 172;run-7449: WARN
+-file -qcow2 172;run-7449: FAIL
--file -qcow2 185;run-7449: FAIL
+-file -qcow2 185;run-7449: PASS
--file -qcow2 186;run-7449: WARN
+-file -qcow2 186;run-7449: FAIL
--file -qcow2 191;run-7449: FAIL
+-file -qcow2 191;run-7449: PASS
--file -raw 192;run-7449: WARN
--file -qcow2 192;run-7449: WARN
+-file -raw 192;run-7449: PASS
+-file -qcow2 192;run-7449: PASS
--file -raw 194;run-7449: FAIL
--file -qcow2 194;run-7449: FAIL
--nbd -raw 194;run-7449: FAIL
--nbd -qcow2 194;run-7449: FAIL
+-file -raw 194;run-7449: PASS
+-file -qcow2 194;run-7449: PASS
+-nbd -raw 194;run-7449: PASS
+-nbd -qcow2 194;run-7449: PASS
--file -raw 208;run-7449: FAIL
--file -qcow2 208;run-7449: FAIL
--nbd -raw 208;run-7449: FAIL
--nbd -qcow2 208;run-7449: FAIL
+-file -raw 208;run-7449: PASS
+-file -qcow2 208;run-7449: PASS
+-nbd -raw 208;run-7449: PASS
+-nbd -qcow2 208;run-7449: PASS

Comment 7 Ademar Reis 2019-03-18 21:08:32 UTC
Our downstream CI team is now running qemu-iotests. Several of them are even enabled in %check as part of rpmbuild.

The ones that are broken in the CI or brew environment are being reported in bugzilla (there are several reported already).

So I'm closing all of the old qemu-iotest BZs. We'll work on them in this more controlled environment of CI and brew.


Note You need to log in before you can comment on or make changes to this bug.