Red Hat Bugzilla – Bug 467737
FEAT: hts certify command should recommend tests to complete certification
Last modified: 2014-03-25 20:55:44 EDT
Description of problem:
The "hts certify" command should be revised to consider existing test results and recommend only those tests required for certification. For example, if the memory test has already passed, it should conduct a test run without the memory test.
A new command, "hts run" could preserve the functionality of the existing "hts certify" command, allowing a manually-defined test run.
Created attachment 320880 [details]
new ResultsEngine class for assessing test results and recomending test runs
The ResultsEngine class analyses test runs from the HTS database (/var/hts/results.xml) and makes recommendations for additional testing.
This initial implementation evaluates test runs to be sure that any mandatory
tests have passed in the same run. If so, the test may be omitted from the
recommended test run.
Created attachment 320885 [details]
hardwaretest.py patch to change certify command to use ResultsEngine class
This patch changes HTS, redefining "hts certify" to use the new ResultsEngine, and adding the "hts run" command as the manual test run command.
The patch also uses the new "mandatory" test designations to determine what tests are required every run, and whether they should preceed or follow the requested tests.
Created attachment 320886 [details]
test.py patch to add mandatory attribute
Created attachment 320890 [details]
certificationtest.py patch to add mandatory test attribute
This patch adds the mandatory attribute to tests.
Created attachment 320891 [details]
tag.py patch to add necessary XML entity and attribute names.
Add necessary XML entity and attribute names for mandatory attributes.
Created attachment 320893 [details]
suspend.py patch to designate it as mandatory, pre
Created attachment 320894 [details]
info.py patch to designate the test as mandatory post
Verified "hts certify" will execute all tests which not passed and "hts run" could execute with specified test or device in hts-5.3.12.
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.