Bug 1252810

Summary: rhcert should not allow submission if "INCOMPLETE" is present in results summary
Product: Red Hat Certification Program Reporter: Swati Goswami <swgoswam>
Component: redhat-certificationAssignee: Greg Nichols <gnichols>
Status: NEW --- QA Contact: rhcert qe <rhcert-qe>
Severity: high Docs Contact:
Priority: unspecified    
Version: 1.0   
Target Milestone: ---   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
rhcert.xml file none

Description Swati Goswami 2015-08-12 09:34:27 UTC 
Created attachment 1061895 [details]
rhcert.xml file

Description of problem:
The rhcert.xml file contains "INCOMPLETE" in the summary , still it is sent to be processed further by Caas or CWE

Version-Release number of selected component (if applicable):
redhat-certification-1.0-20150723

How reproducible:


Steps to Reproduce:
1.https://bugzilla.redhat.com/show_bug.cgi?id=1247366 from this bug , we extracted the logs
2.rhcert.xml says


<?xml version="1.0" encoding="utf-8"?>
<?xml-stylesheet href="/rhcert/css/results.css" type="text/css"?>
<certification-test discover-time="2015-08-11 19:50:12" number-of-runs="2" plan-time="2015-08-11 19:50:12" rhcert-release="20150707" rhcert-version="1.0"><hardware><arch>x86_64</arch><model>KVM</model><make>KVM</make><vendor>Red Hat</vendor><product-url/><specification-url/><support-url/><category>Server</category><test-server ip-address="192.168.100.233">controller</test-server></hardware><certification id="1247366" type="openstack"><os><name>Maipo</name><release>7.1</release><product>Red Hat Enterprise Linux Server</product><hostname>controller</hostname></os></certification><test mandatory="" name="openstack_verify" path="openstack/openstack_verify" priority="999" source="" source-directory="/usr/lib/python2.7/site-packages/rhcert/suites/openstack" status="deleted"><tag>interactive</tag><tag>certification</tag><parameters><property name="testserver">controller</property></parameters><run number="1"><summary>INCOMPLETE</summary></run><run end-time="2015-08-11 21:22:48" mode="server" number="2" run-time="2015-08-11 20:53:29"><summary>INCOMPLETE</summary><parameters/></run></test><test mandatory="" name="rhel_verify" path="openstack_platform/rhel_verify" priority="999" source="" source-directory="/usr/lib/python2.7/site-packages/rhcert/suites/openstack_platform" status="deleted"><tag>non-interactive</tag><tag>certification</tag><parameters><property name="testserver">controller</property></parameters><run number="1"><summary>INCOMPLETE</summary></run></test><test mandatory="" name="openstack_verify" path="openstack/openstack_verify" priority="999" source="" source-directory="/usr/lib/python2.7/site-packages/rhcert/suites/openstack"><tag>interactive</tag><tag>certification</tag><parameters/></test><test mandatory="" name="rhel_verify" path="openstack_platform/rhel_verify" priority="999" source="" source-directory="/usr/lib/python2.7/site-packages/rhcert/suites/openstack_platform"><tag>non-interactive</tag><tag>certification</tag><parameters/></test></certification-test>

Actual results:
<summary>INCOMPLETE</summary> if the summary is incomplete , it should not be sent further for processing while as the bug says , it is being forwarded to CaaS



Additional info:
rhcert.xml is attached