Bug 2122209

Summary: [RFE] VF run with parameters from file allowing for run recording and rerun
Product: Red Hat OpenStack Reporter: Jiri Podivin <jpodivin>
Component: python-validations-libsAssignee: Veronika Fisarova <vfisarov>
Status: CLOSED CURRENTRELEASE QA Contact: Nobody <nobody>
Severity: high Docs Contact:
Priority: high    
Version: 17.1 (Wallaby)CC: dpeacock, jamsmith, jjoyce, joflynn, jschluet, mbultel, rheslop, vfisarov
Target Milestone: gaKeywords: FutureFeature, Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: python-validations-libs-1.9.0-1.20230401020900.136827b.el9ost Doc Type: Enhancement
Doc Text:
This update adds the `validation file` command to the Validation Framework CLI. This command allows you to supply a file with validations by name, group, category and product for a validation run. Now, you can run 'validation file <path_to_file>', and keep the chosen validations for reruns at a later time.
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-08-16 10:34:35 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jiri Podivin 2022-08-29 13:51:28 UTC
Allow user to supply instructions for Validation Framework CLI in form of a file, and ensure that each VF run creates such a file for possible rerun.

Details:
--------
The user should be able to create a yaml file and give that file through the CLI.

The file file will contains:

    a list of  groups or validations name they wanna run
    if they use groups, a list of validations they wanna exclude maybe
    list of the parameters and their values they want to override...

The file structure will have to be decided (like what we have for the validations metadata)

Rationale: Some users/customers will probably want to run always what they want to run and having the ability to feed a yaml file with what they want will avoid them to script or typing complex arguments in the CLI.

Execution of VF run would produce just such a file, alongside existing logs.

Implement a registry mechanism for a given validation run. This will associate a run UUID with the exact instructions for the run.

Comment 10 Lon Hohberger 2023-08-16 10:34:35 UTC
According to our records, this should be resolved by python-validations-libs-1.9.1-1.20230421020958.7213419.el9ost.  This build is available now.