Bug 674375 - v7 certify misses tests where one of serveral devices has passed
Summary: v7 certify misses tests where one of serveral devices has passed
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Hardware Certification Program
Classification: Retired
Component: Test Suite (harness)
Version: 1.2
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: ---
Assignee: Greg Nichols
QA Contact: Red Hat Kernel QE team
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-02-01 16:27 UTC by Greg Nichols
Modified: 2011-05-09 16:14 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
In v7 1.2, certify command failed to add tests for multiple devices if one has already passed. This issue has been fixed in v7 1.3, now if one of multiple devices has passed the test, the rest devices are still able to be added to test.
Clone Of:
Environment:
Last Closed: 2011-05-09 16:14:49 UTC
Embargoed:


Attachments (Terms of Use)
resultsengine.py patch changing processing of remaining tests based on key, not name (808 bytes, patch)
2011-02-01 16:28 UTC, Greg Nichols
no flags Details | Diff


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2011:0497 0 normal SHIPPED_LIVE v7 bug fix and enhancement update 2011-05-09 16:11:16 UTC

Description Greg Nichols 2011-02-01 16:27:12 UTC
Description of problem:

The v7 certify command will fail to add tests for multiple devices if one has passed.  For example, if cpuscaling has passed only on cpu0, v7 certify will no add the remaining cpus to the list of tests to be performed.

Version-Release number of selected component (if applicable):

v7 1.3 R10


Steps to Reproduce:
1. v7 plan on multi-cpu system supporting scaling
2. v7 run --test cpuscaling --device 0
3. v7 certify (note that other cpus are not tested)

Comment 1 Greg Nichols 2011-02-01 16:28:49 UTC
Created attachment 476444 [details]
resultsengine.py patch changing processing of remaining tests based on key, not name

Comment 6 Caspar Zhang 2011-04-29 13:22:47 UTC
Reproduced in R10:

-> network eth1 passed

-> run certify
usb                   None                                
cdrom      sr0        storage_model_DV_18S_A              
dvd        sr0        storage_model_DV_18S_A              
memory                None                                
fv_core               None                                
fv_memory             None                                
fv_storage            None                                
fv_network            None                                
video                 pci_102b_522                        
storage    sda        storage_serial_MB0500EAMZD_9WJ0NJHN 
cpuscaling 0          acpi_CPU0                           
cpuscaling 1          acpi_CPU1                           
cpuscaling 2          acpi_CPU2                           
cpuscaling 3          acpi_CPU3                           
profiler              None                                
core                  None                                
info                  None                                
reboot                None <- no network any more

Verified in R38:

-> run certify

The following tests with tag(s) [certification] are recommended to continue the certification
usb                   None                                
cdrom      sr0        storage_model_DV_18S_A              
dvd        sr0        storage_model_DV_18S_A              
network    eth2       net_3c_4a_92_e0_d1_27               <-- still have network ,but skip eth1
network    eth0       net_00_05_33_26_9e_4f               
memory                None                                
fv_core               None                                
fv_memory             None                                
fv_storage            None                                
fv_network            None                                
video                 pci_102b_522                        
storage    sda        storage_serial_MB0500EAMZD_9WJ0NJHN 
profiler              None                                
core                  None                                
cpuscaling            None                                
info                  None                                
reboot     local      None                                
reboot     nfs        None

Comment 7 Caspar Zhang 2011-05-01 09:34:42 UTC
    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
In v7 1.2, certify command failed to add tests for multiple devices if one has already passed. This issue has been fixed in v7 1.3, now if one of multiple devices has passed the test, the rest devices are still able to be added to test.

Comment 8 errata-xmlrpc 2011-05-09 16:14:49 UTC
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHBA-2011-0497.html


Note You need to log in before you can comment on or make changes to this bug.