Bug 1950605

Summary:	Define tests, including gating tests, for qemu-kvm
Product:	Red Hat Enterprise Linux 9	Reporter:	Jeff Nelson <jen>
Component:	qemu-kvm	Assignee:	Beraldo Leal <bleal>
qemu-kvm sub component:	Testing	QA Contact:	Yanan Fu <yfu>
Status:	CLOSED CURRENTRELEASE	Docs Contact:
Severity:	unspecified
Priority:	unspecified	CC:	bleal, jinzhao, juzhang, virt-maint, yfu, ymankad
Version:	9.0	Keywords:	TestOnly, Triaged
Target Milestone:	beta	Flags:	pm-rhel: mirror+
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2021-12-07 21:20:54 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Jeff Nelson 2021-04-17 04:45:00 UTC

Problem Description:
Define tests, including gating tests, for qemu-kvm.

Additional Information:
In RHEL-8 and in RHEL AV, the virt module contains the definition of tests to be run whenever any component in the module is changed. In RHEL-9 there is no virt module so the tests must now be defined for each of the individual components, of which qemu-kvm is one. The definition must include both gating and non-gating tests.

The suggested approach to resolving this BZ is to copy the test setup for the virt module in RHEL AV-8.5, namely the file named 'gating.yaml' and the directory named 'tests'. Then modify the files to exclude tests and gating tests that are not relevant for qemu-kvm.

Please work closely with QE! The test definitions in gating.yaml describe test jobs that run in QE's testing environment. The test jobs and/or the testing environment may need to be modified to work in RHEL-9, or perhaps brand new test jobs may need to be created.

Comment 1 Yanan Fu 2021-04-19 03:35:36 UTC

Hi there,

QE have copy the tests with RHEL-av 8.5 virt module to RHEL9 qemu-kvm build already.

The 'namespace' for the test result UMB message are:
kvm-ci.qemu-kvm.x86_64-intel.brew-build.gating
kvm-ci.qemu-kvm.x86_64-amd.brew-build.gating

type: tier1
category: functional


So the test case name in gating.yml should be:
kvm-ci.qemu-kvm.x86_64-intel.brew-build.gating.tier1.functional
kvm-ci.qemu-kvm.x86_64-amd.brew-build.gating.tier1.functional


Will provide the example for the UMB message later, thanks!

Comment 2 Jeff Nelson 2021-04-20 04:54:39 UTC

Delegating for further assignment.

I don't expect maintainers to do all the work, but to help move things along.

Please work with the following:

* Yash - he knows how to create the test and gating files that OSCI reads to run tests. He also knows how the QE test systems work.

* lead engineer for the component (I'll help if you don't know who) - for reviewing what tests make sense to run for the component.

* QE assignee - for verifying that the jobs we run which execute on QE's infrastructure will run on RHEL-9 in a non-modular environment. I expect that some tests may need modification.

Comment 6 Yanan Fu 2021-05-19 02:49:34 UTC

No qemu-kvm code change, it is a test only issue i think, let's move to ON_QA directly.

Comment 7 Yanan Fu 2021-05-29 09:12:50 UTC

qemu-kvm gating test already online in kvm ci system, and gating.yaml already be updated in c93:

Test result can be published with to datagrepper successfully now. Here is an example:
https://datagrepper.engineering.redhat.com/id?id=ID:master-jenkins-csb-kvmqe-39065-1621466306548-4359:1:1:1:1&is_raw=true&size=extra-large


Move bz to VERIFIED accordingly.