Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1052762

Summary: hwcert-backend certify doesn't run expected tests
Product: [Retired] Red Hat Hardware Certification Program Reporter: Brian Brock <bbrock>
Component: Test Suite (harness)Assignee: Greg Nichols <gnichols>
Status: CLOSED EOL QA Contact: Red Hat Kernel QE team <kernel-qe>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 1.7.0CC: rlandry
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: hwcert-client 1.7.0-20140120 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
: 1055803 (view as bug list) Environment:
Last Closed: 2020-03-27 15:46:52 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1016295    
Attachments:
Description Flags
patch to handle results not linked to certifications none

Description Brian Brock 2014-01-14 01:43:57 UTC
Description of problem:
hwcwert-backend certify does not run all tests.  Only seen on s390x so far.

Version-Release number of selected component (if applicable):
hwcert-client-1.7.0-20140113

How reproducible:
reproducible on s390x only (so far)

Steps to Reproduce:
1. install rhel 7 beta on s390x
2. run `hwcert-backend plan` to check that the hardware catalog generates an accurate test plan.
2. run `hwcert-backend certify`

Actual results:


$ hwcert-backend certify
Warning: test run 1 is disqualified due to mandatory test info failure
Warning: test run 2 is disqualified due to mandatory test info failure
There are no open tests remaining in the certification
Testing appears to be complete.





Expected results:


Additional info:

Comment 6 Greg Nichols 2014-01-20 16:08:37 UTC
Created attachment 852795 [details]
patch to handle results not linked to certifications

This patch adds logic to handle cases where there is no certification associated with the results when the certify command checks for open certification tests.  If there is no certification associated, hwcert-client will ask the user if this is a new or existing certification.

If there is no certification associated, the command will suggest running tests that have not passed locally.

Comment 7 Brian Brock 2014-02-10 22:41:13 UTC
verified in hwcert-client-1.7.0-20140207.el7

certify now runs the tests which have not already passed