Bug 1246226

Summary:	tests appear in plan multiple times after test run
Product:	Red Hat Certification Program	Reporter:	Brian Brock <bbrock>
Component:	redhat-certification	Assignee:	Greg Nichols <gnichols>
Status:	CLOSED ERRATA	QA Contact:	Brian Brock <bbrock>
Severity:	unspecified	Docs Contact:
Priority:	unspecified
Version:	1.0	CC:	brose
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	redhat-certification-1.0-20150812	Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2015-11-19 16:35:22 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Brian Brock 2015-07-23 18:13:42 UTC

When tests are launched from the UI, more than one result line is sometimes printed for some tests.

redhat-certification-1.0-20150707.el7.noarch
redhat-certification-hardware-1.7.1-20150721.el7.noarch

Not reproduced yet on other systems.  I was testing redhat-certification-hardware, not any other test packages.

Steps to Reproduce:
1. `rhcert-backend plan` to create a test plan in the CLI.
2. `rhcert-backend run --test=$TEST` to execute a single test.
3. `rhcert-backend print` to view results

Actual results:
Run: 1 on 2015-07-22 19:22:10                                                                                                                                                                        
--------------------------------------------
Tests: 27 planned,  1 run, 1 passed, 0 failed
--------------------------------------------


Test Run 1
-----------------------------------------------------------------------------
cdrom       sr0     /devices/pci0000:00/0000:00:1f.2/ata1/host1/target1:0:0/1:0:0:0/block/sr0 - 
dvd         sr0     /devices/pci0000:00/0000:00:1f.2/ata1/host1/target1:0:0/1:0:0:0/block/sr0 - 
usb2                /devices/pci0000:00/0000:00:1a.7/usb1              - 
kdump       nfs                                                        - 
kdump       local                                                      - 
1GigEthernet enp1s0f0 /devices/pci0000:00/0000:00:01.0/0000:01:00.0/net/enp1s0f0 - 
memory                                                                 - 
core                                                                   - 
cpuscaling                                                             - 
fv_core                                                                - 
fv_memory                                                              - 
fv_network                                                             - 
fv_storage                                                             - 
profiler                                                               - 
storage     host0   /devices/pci0000:00/0000:00:03.0/0000:07:00.0/host0/target0:2:0/0:2:0:0/block/sda - PASS
video               /devices/pci0000:00/0000:00:1c.4/0000:11:00.0      - 
info                                                                   - 
storage     host0   /devices/pci0000:00/0000:00:03.0/0000:07:00.0/host0/target0:2:0/0:2:0:0/block/sda - 
cpuscaling                                                             - 
core                                                                   - 
memory                                                                 - 
profiler                                                               - 
info                                                                   - 
fv_core                                                                - 
fv_memory                                                              - 
fv_network                                                             - 
fv_storage                                                             - 

note that memory, core, cpuscaling, profiler, info, and fv_* are listed more than once in the plan.  In later cases, two passing results were recorded for the info test.

Expected results:
No duplicated items output by print command.  Tests only run once for each `run` from the CLI.

Additional info:

Comment 1 Brian Brock 2015-07-23 18:37:12 UTC

Also seen in 6.7 with:
redhat-certification-1.0-20150723.el6.noarch
redhat-certification-hardware-1.6.6-20150721.el6.noarch

Comment 2 Brian Brock 2015-07-23 18:38:03 UTC

It's possible that the server was running on the SUT (with tests completed via the web UI) in both cases I've seen this bug.

Comment 3 Brian Brock 2015-07-23 19:43:51 UTC

running subsequent tests adds even more tests to the list.

Comment 4 Brian Brock 2015-07-23 19:44:54 UTC

The extra tests scheduled are actually executed.

Comment 5 Greg Nichols 2015-08-05 16:43:29 UTC

*** Bug 1246250 has been marked as a duplicate of this bug. ***

Comment 6 Greg Nichols 2015-08-05 16:45:09 UTC

The error occurs when mixing use of the web UI and the commandline, when the test plan validity is checked, the extra "testserver" parameter makes the tests look different when the plans are compared.

Comment 7 Greg Nichols 2015-08-12 19:02:58 UTC

Correction: This bug can happen if either web UI or the command line is used.

(In reply to Greg Nichols from comment #6)
> The error occurs when mixing use of the web UI and the commandline, when the
> test plan validity is checked, the extra "testserver" parameter makes the
> tests look different when the plans are compared.

Comment 10 Brian Brock 2015-09-10 18:17:48 UTC

verified in
redhat-certification-2.0-20150909.el6.noarch
redhat-certification-hardware-1.6.6-20150901.el6.noarch
redhat-certification-2.0-20150909.el7.noarch
redhat-certification-hardware-1.7.1-20150901.el7.noarch

Comment 12 errata-xmlrpc 2015-11-19 16:35:22 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2015-2479.html