Bug 1014098

Summary: Intermittently produced wrong TEST-org.jboss.as.clustering.infinispan.subsystem.*.xml reports
Product: [JBoss] JBoss Enterprise Application Platform 6 Reporter: Pavel Jelinek <pjelinek>
Component: TestsuiteAssignee: Ondřej Žižka <ozizka>
Status: CLOSED DUPLICATE QA Contact: Pavel Jelinek <pjelinek>
Severity: medium Docs Contact: Russell Dickenson <rdickens>
Priority: unspecified    
Version: 6.1.1, 6.2.0CC: cdewolf, jkudrnac, rhusar, rjanik
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-07-30 08:02:37 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 996500    
Attachments:
Description Flags
RHEL5x86 reports
none
RHEL5x86_64 reports
none
RHEL6x86 example report none

Description Pavel Jelinek 2013-10-01 12:18:01 UTC
Created attachment 805890 [details]
RHEL5x86 reports

maven-surefire-plugin often produces wrong reports for org.jboss.as.clustering.infinispan.subsystem test package. 

e.g.
<testsuite failures="0" time="0" errors="0" skipped="1" tests="1" name="org.jboss.as.clustering.infinispan.subsystem.OperationsTestCase">
  <properties>
    ...
  </properties>
  <testcase time="0" classname="org.jboss.as.clustering.infinispan.subsystem.SubsystemParsingTestCase" name="org.jboss.as.clustering.infinispan.subsystem.SubsystemParsingTestCase">
    <skipped/>
  </testcase>
</testsuite>

One of the consequences is incorrect number of run tests presented by jenkins, example runs (differnet count of run tests for same package, all tests are passed or skipped) : 

https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-AS-Testsuite/job/eap-60-as-testsuite-RHEL-matrix-OracleJDK6/99/jdk=java16_default,label_exp=RHEL5%26%26x86/testReport/org.jboss.as.clustering.infinispan.subsystem/

https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-AS-Testsuite/job/eap-60-as-testsuite-RHEL-matrix-OracleJDK6/99/jdk=java16_default,label_exp=RHEL5%26%26x86_64/testReport/org.jboss.as.clustering.infinispan.subsystem/

https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-AS-Testsuite/job/eap-60-as-testsuite-RHEL-matrix-OracleJDK6/99/jdk=java16_default,label_exp=RHEL6%26%26x86/testReport/org.jboss.as.clustering.infinispan.subsystem/

https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-AS-Testsuite/job/eap-60-as-testsuite-RHEL-matrix-OracleJDK6/99/jdk=java16_default,label_exp=RHEL6%26%26x86_64/testReport/org.jboss.as.clustering.infinispan.subsystem/

Comment 3 Radoslav Husar 2013-10-01 14:08:16 UTC
Seems to really be a problem with the report. Looking at the log, for e.g. 

https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-AS-Testsuite/job/eap-60-as-testsuite-RHEL-matrix-OracleJDK6/97/jdk=java16_default,label_exp=RHEL5%26%26x86_64/testReport/org.jboss.as.clustering.infinispan.subsystem/

shows only 4 test classes being run.

However, all the tests have been run, only the report is lacking:

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Concurrency config is parallel='false', perCoreThreadCount=true, threadCount=2, useUnlimitedThreads=false
Running org.jboss.as.clustering.infinispan.subsystem.OperationsTestCase
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.433 sec
Running org.jboss.as.clustering.infinispan.subsystem.InfinispanSubsystemTestCase
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.592 sec
Running org.jboss.as.clustering.infinispan.subsystem.InfinispanSubsystemTransformerTestCase
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.669 sec
Running org.jboss.as.clustering.infinispan.subsystem.OperationSequencesTestCase
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.816 sec
Running org.jboss.as.clustering.infinispan.subsystem.OperationsTestCase
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0 sec
Running org.jboss.as.clustering.infinispan.DefaultEmbeddedCacheManagerTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.136 sec

I don't see anything clustering specific, assigning to testsuite component.

Comment 4 Pavel Jelinek 2014-07-30 08:02:37 UTC

*** This bug has been marked as a duplicate of bug 1124348 ***