Bug 1669922 - Backport avocado-qemu tests for QEMU 3.1
Summary: Backport avocado-qemu tests for QEMU 3.1
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux Advanced Virtualization
Classification: Red Hat
Component: qemu-kvm
Version: 8.0
Hardware: All
OS: Linux
unspecified
medium
Target Milestone: rc
: 8.0
Assignee: Yash Mankad
QA Contact: Qianqian Zhu
URL:
Whiteboard:
Depends On: 1655807
Blocks: 1669924
TreeView+ depends on / blocked
 
Reported: 2019-01-28 02:10 UTC by Yash Mankad
Modified: 2019-11-12 00:11 UTC (History)
11 users (show)

Fixed In Version: qemu-kvm-3.1.0-13.module+el8+2783+15cec5ae
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 1655807
Environment:
Last Closed: 2019-05-29 16:05:30 UTC
Type: Bug
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2019:1293 0 None None None 2019-05-29 16:05:55 UTC

Description Yash Mankad 2019-01-28 02:10:04 UTC
+++ This bug was initially created as a clone of Bug #1655807 +++

Description of problem:
Backport the Avocado QEMU tests from upstream and include them in qemu-kvm-3.1.0-y.module+el8 builds, so that we can run them as gating tests for the 8.0.0 stream of the virt module in the OSCI environment.
http://pkgs.devel.redhat.com/cgit/modules/virt/tree/?h=8.0.0

Version-Release number of selected component (if applicable):
qemu-kvm-3.1.0-y.module+el8

Comment 5 Danilo de Paula 2019-02-08 12:43:40 UTC
We need QA_ACK and PM_ACK please.

Comment 6 Danilo de Paula 2019-02-11 20:01:15 UTC
Fix included in qemu-kvm-3.1.0-13.module+el8+2783+15cec5ae

Comment 7 Qianqian Zhu 2019-02-12 07:06:20 UTC
Test passed by following steps in comment 3:

[root@ibm-x3250m6-08 ~]# avocado run -p qemu_bin=/usr/libexec/qemu-kvm  /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/
JOB ID     : ae05cabf405db8baab00495e287b4312095a00d3
JOB LOG    : /root/avocado/job-results/job-2019-02-12T01.59-ae05cab/job.log
 (1/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test: PASS (25.55 s)
 (2/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_exit_error_msg: PASS (0.06 s)
 (3/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/version.py:Version.test_qmp_human_info_version: PASS (0.06 s)
 (4/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_conventional_devs: PASS (1.10 s)
 (5/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_modern_only_devs: PASS (0.37 s)
 (6/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/vnc.py:Vnc.test_no_vnc: PASS (0.05 s)
 (7/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/vnc.py:Vnc.test_no_vnc_change_password: PASS (0.05 s)
 (8/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/vnc.py:Vnc.test_vnc_change_password_requires_a_password: PASS (0.05 s)
 (9/9) /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/vnc.py:Vnc.test_vnc_change_password: PASS (0.05 s)
RESULTS    : PASS 9 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB TIME   : 28.67 s
JOB HTML   : /root/avocado/job-results/job-2019-02-12T01.59-ae05cab/results.html

But it hit error when execute `make check-acceptance` directly as what we did for qemu-2.12:

[root@ibm-x3250m6-08 qemu-3.1.0]# make check-acceptance
  VENV    /root/rpmbuild/BUILD/qemu-3.1.0/tests/venv
  PIP     /root/rpmbuild/BUILD/qemu-3.1.0/tests/requirements.txt
  MKDIR   /root/rpmbuild/BUILD/qemu-3.1.0/tests/results
  AVOCADO tests/acceptance
Error running method "render" of plugin "html": 'avocado.core.result.Result object' has no attribute 'rate'

Hi Yash, is that what we expected? Thanks.

Comment 8 Cleber Rosa 2019-02-12 13:39:19 UTC
(In reply to Qianqian Zhu from comment #7)
> Test passed by following steps in comment 3:
> 
> [root@ibm-x3250m6-08 ~]# avocado run -p qemu_bin=/usr/libexec/qemu-kvm 
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/
> JOB ID     : ae05cabf405db8baab00495e287b4312095a00d3
> JOB LOG    : /root/avocado/job-results/job-2019-02-12T01.59-ae05cab/job.log
>  (1/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/boot_linux_console.py:
> BootLinuxConsole.test: PASS (25.55 s)
>  (2/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/linux_initrd.py:LinuxInitrd.
> test_with_2gib_file_should_exit_error_msg: PASS (0.06 s)
>  (3/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/version.py:Version.
> test_qmp_human_info_version: PASS (0.06 s)
>  (4/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/virtio_version.py:
> VirtioVersionCheck.test_conventional_devs: PASS (1.10 s)
>  (5/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/virtio_version.py:
> VirtioVersionCheck.test_modern_only_devs: PASS (0.37 s)
>  (6/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/vnc.py:Vnc.test_no_vnc:
> PASS (0.05 s)
>  (7/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/vnc.py:Vnc.
> test_no_vnc_change_password: PASS (0.05 s)
>  (8/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/vnc.py:Vnc.
> test_vnc_change_password_requires_a_password: PASS (0.05 s)
>  (9/9)
> /root/rpmbuild/BUILD/qemu-3.1.0/tests/acceptance/vnc.py:Vnc.
> test_vnc_change_password: PASS (0.05 s)
> RESULTS    : PASS 9 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 |
> CANCEL 0
> JOB TIME   : 28.67 s
> JOB HTML   :
> /root/avocado/job-results/job-2019-02-12T01.59-ae05cab/results.html
> 
> But it hit error when execute `make check-acceptance` directly as what we
> did for qemu-2.12:
> 
> [root@ibm-x3250m6-08 qemu-3.1.0]# make check-acceptance
>   VENV    /root/rpmbuild/BUILD/qemu-3.1.0/tests/venv
>   PIP     /root/rpmbuild/BUILD/qemu-3.1.0/tests/requirements.txt
>   MKDIR   /root/rpmbuild/BUILD/qemu-3.1.0/tests/results
>   AVOCADO tests/acceptance
> Error running method "render" of plugin "html": 'avocado.core.result.Result
> object' has no attribute 'rate'
> 

This is caused by a version mismatch of Avocado and the HTML plugin, and is probably caused by the fact that you may have a different, standalone, Avocado + HTML plugin installation on your system.

`make check-acceptance` will install a specific version of Avocado, with which the tests are supposed to work well with, but it won't disable external that have been installed system wide. 

> Hi Yash, is that what we expected? Thanks.

Comment 9 Qianqian Zhu 2019-02-13 06:27:34 UTC
Thanks Yash, I did have an external avocado installed, I have tried clean it and run `make check-acceptance` again, all tests passed. So will move to VERIFIED after it ON_QA.

Comment 10 Yash Mankad 2019-02-13 06:36:11 UTC
Thanks Cleber for the explanation and Qianqian for verifying!

Comment 12 Qianqian Zhu 2019-02-25 01:59:36 UTC
Moving to VERIFIED per comment 7 and comment 9, thanks Cleber and Yash.

Comment 14 errata-xmlrpc 2019-05-29 16:05:30 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:1293


Note You need to log in before you can comment on or make changes to this bug.