Bug 1664989

Summary: Updates to qemu-kvm-tests.rpm: include more avocado_qemu tests, fix qemu-iotests
Product: Red Hat Enterprise Linux Advanced Virtualization Reporter: Yash Mankad <ymankad>
Component: qemu-kvmAssignee: Yash Mankad <ymankad>
Status: CLOSED ERRATA QA Contact: jingzhao <jinzhao>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 8.1CC: areis, chayang, coli, ddepaula, jen, jinzhao, juzhang, rbalakri, virt-maint
Target Milestone: rc   
Target Release: 8.1   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: qemu-kvm-4.0.0-3.module+el8.1.0+3265+26c4ed71 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-11-06 07:12:49 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Comment 5 jingzhao 2019-07-18 05:36:06 UTC
Test against with qemu-kvm-4.0.0-5.module+el8.1.0+3622+5812d9bf.x86_64

# cd /usr/lib64/qemu-kvm/tests-src
[root@ibm-x3250m6-11 tests-src]# tree -L 2
.
├── python
│   └── qemu
├── README
├── scripts
│   └── qmp
└── tests
    ├── acceptance
    ├── Makefile.include
    └── qemu-iotests

7 directories, 2 files

# avocado run -p qemu_bin=/usr/libexec/qemu-kvm /usr/lib64/qemu-kvm/tests-src/tests/acceptance/
JOB ID     : 17a7e1a779ea327e8f21fac36962574a89cdb18b
JOB LOG    : /root/avocado/job-results/job-2019-07-18T01.31-17a7e1a/job.log
 (01/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test: INTERRUPTED: Failed to fetch vmlinuz.\nRunner error occurred: Timeout reached\nOriginal status: ERROR\n{'name': '01-/usr/lib64/qemu-kvm/tests-src/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test', 'logdir': '/root/avocado/job-results/job-2019-07-18T01.31-17a7... (60.45 s)
 (02/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/cpu_queries.py:QueryCPUModelExpansion.test: PASS (0.13 s)
 (03/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_exit_error_msg_with_linux_v3_6: PASS (15.51 s)
 (04/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_work_with_linux_v4_16: PASS (18.48 s)
 (05/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/migration.py:Migration.test_migration_with_tcp_localhost: PASS (0.51 s)
 (06/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/version.py:Version.test_qmp_human_info_version: PASS (0.05 s)
 (07/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_conventional_devs: PASS (1.11 s)
 (08/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_modern_only_devs: PASS (0.41 s)
 (09/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/vnc.py:Vnc.test_no_vnc: PASS (0.05 s)
 (10/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/vnc.py:Vnc.test_no_vnc_change_password: PASS (0.05 s)
 (11/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/vnc.py:Vnc.test_vnc_change_password_requires_a_password: PASS (0.06 s)
 (12/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/vnc.py:Vnc.test_vnc_change_password: PASS (0.05 s)
RESULTS    : PASS 11 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 1 | CANCEL 0
JOB TIME   : 98.55 s
JOB HTML   : /root/avocado/job-results/job-2019-07-18T01.31-17a7e1a/results.html


# avocado run -p qemu_bin=/usr/libexec/qemu-kvm /usr/lib64/qemu-kvm/tests-src/tests/acceptance/
JOB ID     : 486689f7d62fa8bcf091d8526143120d0e5ba03b
JOB LOG    : /root/avocado/job-results/job-2019-07-18T01.33-486689f/job.log
 (01/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test: PASS (1.08 s)
 (02/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/cpu_queries.py:QueryCPUModelExpansion.test: PASS (0.16 s)
 (03/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_exit_error_msg_with_linux_v3_6: PASS (0.72 s)
 (04/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_work_with_linux_v4_16: PASS (2.97 s)
 (05/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/migration.py:Migration.test_migration_with_tcp_localhost: PASS (0.33 s)
 (06/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/version.py:Version.test_qmp_human_info_version: PASS (0.05 s)
 (07/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_conventional_devs: PASS (1.21 s)
 (08/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_modern_only_devs: PASS (0.39 s)
 (09/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/vnc.py:Vnc.test_no_vnc: PASS (0.05 s)
 (10/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/vnc.py:Vnc.test_no_vnc_change_password: PASS (0.05 s)
 (11/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/vnc.py:Vnc.test_vnc_change_password_requires_a_password: PASS (0.05 s)
 (12/12) /usr/lib64/qemu-kvm/tests-src/tests/acceptance/vnc.py:Vnc.test_vnc_change_password: PASS (0.05 s)
RESULTS    : PASS 12 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB TIME   : 8.55 s
JOB HTML   : /root/avocado/job-results/job-2019-07-18T01.33-486689f/results.html

Hi Yash

Can we mark it as verified since hit error when execute # avocado run -p qemu_bin=/usr/libexec/qemu-kvm /usr/lib64/qemu-kvm/tests-src/tests/acceptance/ firstly but all passed when run again


Thanks
Jing

Comment 6 Yash Mankad 2019-07-18 22:40:38 UTC
Hi Jing,

Yes, you can mark it as VERIFIED, as the important thing to note is that all updated 12 tests have been backported successfully. 
The timeout is caused due to external URLs taking too long to respond and that is something we can't change / control.

As you noticed, this particular error is intermittent and will go away if you simply the re-run the tests.

Thanks,
Yash

Comment 9 errata-xmlrpc 2019-11-06 07:12:49 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:3723