Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 900938 (JBPAPP6-1311)

Summary: JBossWS CXF TS hangs on Windows, orphan java processes of appclient
Product: [JBoss] JBoss Enterprise Application Platform 6 Reporter: Rostislav Svoboda <rsvoboda>
Component: Web ServicesAssignee: Jim Ma <ema>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: high Docs Contact:
Priority: high    
Version: 6.0.1CC: asoldano, atangrin, cfang, ema, jason.greene, ropalka, rsvoboda, tomaz.cerar
Target Milestone: ER1   
Target Release: EAP 6.1.0   
Hardware: Unspecified   
OS: Unspecified   
URL: http://jira.jboss.org/jira/browse/JBPAPP6-1311
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-07-23 18:35:50 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
unexpected-process-2.stacktrace.txt
none
unexpected-process-1.stacktrace.txt
none
jbossws-cxf-ts.stacktrace.txt none

Description Rostislav Svoboda 2012-09-26 13:33:54 UTC 
project_key: JBPAPP6

JBossWS CXF 4.0.5.GA TS hangs on windows and doesn't continue, verified on Hudson and manually too.

https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-WS/job/eap-60-jbossws-testsuite-alpha-win/49/consoleText

TS hangs when finishing shared-tests before forked-integration-tests on shared-tests.

After some debugging I found that there are 2 pending java processes related to TS. When I killed those 2 processes TS continued properly with forked-integration-tests.

Those two processes are related to jaxws-samples-webserviceref-appclient and jaxws-samples-serviceref-appclient, thread dumps attached (jstack -l %PID%).

*Unexpected process 1: (PID 50852)*
"W:\tmp\jdk1.6.0_last\bin\java"  -Dprogram.name=appclient.bat -Djboss.bind.address=localhost -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv6Addresses=false  -server  "-Dorg.jboss.boot.log.file=w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\appclient\log\boot.log"  "-Dlogging.configuration=file:w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0/appclient/configuration/logging.properties"     -jar "w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\jboss-modules.jar"     -mp "w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\modules"     -jaxpmodule "javax.xml.jaxp-provider"      org.jboss.as.appclient     -Djboss.home.dir="w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0"     -Djboss.server.base.dir="w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\appclient"      --appclient-config=appclient-ws.xml W:\workspace\eap-60-jbossws-testsuite-alpha-win\stack-cxf\modules\testsuite\shared-tests\target\test-libs\jaxws-samples-serviceref-appclient.ear#jaxws-samples-serviceref-appclient.jar "Hello World!"

*Unexpected process 2: (PID 50400)*
"W:\tmp\jdk1.6.0_last\bin\java"  -Dprogram.name=appclient.bat -Djboss.bind.address=localhost -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv6Addresses=false  -server  "-Dorg.jboss.boot.log.file=w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\appclient\log\boot.log"  "-Dlogging.configuration=file:w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0/appclient/configuration/logging.properties"     -jar "w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\jboss-modules.jar"     -mp "w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\modules"     -jaxpmodule "javax.xml.jaxp-provider"      org.jboss.as.appclient     -Djboss.home.dir="w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0"     -Djboss.server.base.dir="w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\appclient"      --appclient-config=appclient-ws.xml W:\workspace\eap-60-jbossws-testsuite-alpha-win\stack-cxf\modules\testsuite\shared-tests\target\test-libs\jaxws-samples-webserviceref-appclient.ear#jaxws-samples-webserviceref-appclient.jar "Hello World!"

*WS CXF TS : (PID 45532)*
"W:\tmp\jdk1.6.0_last\bin\java.exe"   -classpath "w:\tmp\maven-3.0.4\bin\..\boot\plexus-classworlds-2.4.jar" "-Dclassworlds.conf=w:\tmp\maven-3.0.4\bin\..\bin\m2.conf" "-Dmaven.home=w:\tmp\maven-3.0.4\bin\.." org.codehaus.plexus.classworlds.launcher.Launcher -s settings.xml -e -Ptestsuite,hudson,jboss712 -Dmaven.repo.local=w:\workspace\eap-60-jbossws-testsuite-alpha-win\local-repo -Djboss712.home=w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0 -Djbossws-native-core.filename=jbossws-native-core-4.0.5.GA-redhat-1.jar integration-test
Comment 1 Rostislav Svoboda 2012-09-26 13:34:12 UTC 
Attachment: Added: unexpected-process-2.stacktrace.txt
Attachment: Added: unexpected-process-1.stacktrace.txt
Attachment: Added: jbossws-cxf-ts.stacktrace.txt
Comment 2 Rostislav Svoboda 2012-10-01 11:34:00 UTC 
It can be related to https://source.jboss.org/changelog/JBossWS?cs=16234 change for JBPAPP-8897 + JBPAPP-8895
Comment 3 Alessio Soldano 2012-10-04 09:39:24 UTC 
Link: Added: This issue is a dependency of JBPAPP-10113
Comment 4 Anne-Louise Tangring 2012-10-08 14:22:50 UTC 
Approved for EAP 6.0.1
Comment 5 Jason Greene 2012-10-08 17:12:24 UTC 
Jim do you have an update on this one?
Comment 6 Alessio Soldano 2012-10-10 08:56:14 UTC 
Link: Removed: This issue is a dependency of JBPAPP-10113
Comment 7 Jason Greene 2012-10-10 18:03:13 UTC 
Jim is on PTO. Alessio was going to take a look at it. It is believed to be a testsuite issue and not an actual bug.
Comment 8 Cheng Fang 2012-10-11 16:01:03 UTC 
I looked at AppclientHelper class linked in Rostislav's comment, it uses ExecutorService es = Executors.newCachedThreadPool that was not shutdown(), and could've caused the hang.  We may need to add a es.shutdown() in shutdownAppclient().  Could someone try that?

The hang problem might have been there all along, but was previously shadowed by the 2 bugs listed in the first comment.
Comment 9 Alessio Soldano 2012-10-11 16:16:08 UTC 
Thanks Cheng, I'll check that.
Comment 10 Alessio Soldano 2012-10-12 14:19:12 UTC 
OK, Richard worked a bit on this and applied a patch that should fix the problem. The changes are committed on jbossws-shared-testsuite 4.0.x maintenance branch; can perhaps QE validate them by running the testsuite on a Windows machine using the current jbossws-shared-testsuite 4.0.8-SNAPSHOT? Thanks.
Comment 11 Alessio Soldano 2012-10-12 14:20:31 UTC 
Hi Rotislav, please see my last comment on QE testing. Thanks.
Comment 12 Rostislav Svoboda 2012-10-15 12:29:31 UTC 
Tested with jbossws-shared-testsuite 4.0.8-SNAPSHOT, issue is still present.

Snapshot version of jbossws-shared-testsuite: 4.0.8-20121012.133630-1

[INFO] +- org.jboss.ws:jbossws-shared-testsuite:jar:4.0.8-SNAPSHOT:test

PID: 13076
"T:\opt\windows\jdk1.6.0_32\bin\java"  -Dprogram.name=appclient.bat -Djboss.bind.address=localhost -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv6Addresses=false  -server  "-Dorg.jboss.boot.log.file=w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\appclient\log\boot.log"  "-Dlogging.configuration=file:w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0/appclient/configuration/logging.properties"     -jar "w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\jboss-modules.jar"     -mp "w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\modules"     -jaxpmodule "javax.xml.jaxp-provider"      org.jboss.as.appclient     -Djboss.home.dir="w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0"     -Djboss.server.base.dir="w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\appclient"      --appclient-config=appclient-ws.xml W:\workspace\eap-60-jbossws-testsuite-alpha-win\stack-cxf\modules\testsuite\shared-tests\target\test-libs\jaxws-samples-serviceref-appclient.ear#jaxws-samples-serviceref-appclient.jar "Hello World!"

PID: 10272
"T:\opt\windows\jdk1.6.0_32\bin\java"  -Dprogram.name=appclient.bat -Djboss.bind.address=localhost -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv6Addresses=false  -server  "-Dorg.jboss.boot.log.file=w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\appclient\log\boot.log"  "-Dlogging.configuration=file:w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0/appclient/configuration/logging.properties"     -jar "w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\jboss-modules.jar"     -mp "w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\modules"     -jaxpmodule "javax.xml.jaxp-provider"      org.jboss.as.appclient     -Djboss.home.dir="w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0"     -Djboss.server.base.dir="w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\appclient"      --appclient-config=appclient-ws.xml W:\workspace\eap-60-jbossws-testsuite-alpha-win\stack-cxf\modules\testsuite\shared-tests\target\test-libs\jaxws-samples-webserviceref-appclient.ear#jaxws-samples-webserviceref-appclient.jar "Hello World!"

STACK FOR PID 13076
{code}
2012-10-15 08:01:35
Full thread dump Java HotSpot(TM) Server VM (20.7-b02 mixed mode):

"pool-3-thread-2" prio=6 tid=0x4a81f400 nid=0x1bfc waiting on condition [0x4c29f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x355dcc78> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
	at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
	at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
	- None

"pool-3-thread-1" prio=6 tid=0x4a81fc00 nid=0x22cc waiting on condition [0x4cdff000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x355dcc78> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
	at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
	at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
	- None

"DestroyJavaVM" prio=6 tid=0x4b1a8800 nid=0x2808 waiting on condition [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Reference Reaper" daemon prio=6 tid=0x49eeb000 nid=0x29fc in Object.wait() [0x4a63f000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x0987d888> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
	- locked <0x0987d888> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
	at org.jboss.modules.ref.References$ReaperThread.run(References.java:68)

   Locked ownable synchronizers:
	- None

"Low Memory Detector" daemon prio=6 tid=0x49e3b800 nid=0xe30 runnable [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread1" daemon prio=10 tid=0x49e38000 nid=0x1a4c waiting on condition [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread0" daemon prio=10 tid=0x49e2bc00 nid=0x3150 waiting on condition [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Attach Listener" daemon prio=10 tid=0x49e29000 nid=0x1370 waiting on condition [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Signal Dispatcher" daemon prio=10 tid=0x00d2f800 nid=0x12f0 runnable [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Finalizer" daemon prio=8 tid=0x49e06800 nid=0x3160 in Object.wait() [0x4a14f000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x09734228> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
	- locked <0x09734228> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

   Locked ownable synchronizers:
	- None

"Reference Handler" daemon prio=10 tid=0x49e06400 nid=0x2510 in Object.wait() [0x4a0bf000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x097341e0> (a java.lang.ref.Reference$Lock)
	at java.lang.Object.wait(Object.java:485)
	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
	- locked <0x097341e0> (a java.lang.ref.Reference$Lock)

   Locked ownable synchronizers:
	- None

"VM Thread" prio=10 tid=0x00d23000 nid=0x2c8c runnable 

"GC task thread#0 (ParallelGC)" prio=6 tid=0x00c6b800 nid=0x2650 runnable 

"GC task thread#1 (ParallelGC)" prio=6 tid=0x00c6cc00 nid=0x31f8 runnable 

"GC task thread#2 (ParallelGC)" prio=6 tid=0x00c6dc00 nid=0x1280 runnable 

"GC task thread#3 (ParallelGC)" prio=6 tid=0x00c6f000 nid=0x240c runnable 

"GC task thread#4 (ParallelGC)" prio=6 tid=0x00c72000 nid=0x23f0 runnable 

"GC task thread#5 (ParallelGC)" prio=6 tid=0x00c73000 nid=0x2514 runnable 

"GC task thread#6 (ParallelGC)" prio=6 tid=0x00c73c00 nid=0x33c0 runnable 

"GC task thread#7 (ParallelGC)" prio=6 tid=0x00c74c00 nid=0xfb4 runnable 

"VM Periodic Task Thread" prio=10 tid=0x49e3c800 nid=0x32ec waiting on condition 

JNI global references: 954
{code}


STACK FOR PID 10272
{code}
2012-10-15 08:01:46
Full thread dump Java HotSpot(TM) Server VM (20.7-b02 mixed mode):

"pool-3-thread-2" prio=6 tid=0x4a9df800 nid=0x1018 waiting on condition [0x4c29f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x099af6b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
	at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
	at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
	- None

"pool-3-thread-1" prio=6 tid=0x4a9e0000 nid=0x7dc waiting on condition [0x4ccbf000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x099af6b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
	at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
	at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
	- None

"DestroyJavaVM" prio=6 tid=0x4ae1b800 nid=0x131c waiting on condition [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Reference Reaper" daemon prio=6 tid=0x49edb000 nid=0xc74 in Object.wait() [0x4a63f000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x0995be90> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
	- locked <0x0995be90> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
	at org.jboss.modules.ref.References$ReaperThread.run(References.java:68)

   Locked ownable synchronizers:
	- None

"Low Memory Detector" daemon prio=6 tid=0x49e3b800 nid=0x19cc runnable [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread1" daemon prio=10 tid=0x49e38400 nid=0x20c8 waiting on condition [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread0" daemon prio=10 tid=0x49e29800 nid=0x1d24 waiting on condition [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Attach Listener" daemon prio=10 tid=0x49e29000 nid=0x1ab0 waiting on condition [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Signal Dispatcher" daemon prio=10 tid=0x006ff800 nid=0x12a4 runnable [0x00000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Finalizer" daemon prio=8 tid=0x006f7400 nid=0x2760 in Object.wait() [0x4a14f000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x097aefc0> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
	- locked <0x097aefc0> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

   Locked ownable synchronizers:
	- None

"Reference Handler" daemon prio=10 tid=0x49e05400 nid=0x1b60 in Object.wait() [0x4a0bf000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x09749828> (a java.lang.ref.Reference$Lock)
	at java.lang.Object.wait(Object.java:485)
	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
	- locked <0x09749828> (a java.lang.ref.Reference$Lock)

   Locked ownable synchronizers:
	- None

"VM Thread" prio=10 tid=0x006f2000 nid=0x2e7c runnable 

"GC task thread#0 (ParallelGC)" prio=6 tid=0x0063b800 nid=0xf00 runnable 

"GC task thread#1 (ParallelGC)" prio=6 tid=0x0063cc00 nid=0x263c runnable 

"GC task thread#2 (ParallelGC)" prio=6 tid=0x0063e000 nid=0x252c runnable 

"GC task thread#3 (ParallelGC)" prio=6 tid=0x0063f000 nid=0x1b1c runnable 

"GC task thread#4 (ParallelGC)" prio=6 tid=0x00642000 nid=0x3190 runnable 

"GC task thread#5 (ParallelGC)" prio=6 tid=0x00643000 nid=0x1c98 runnable 

"GC task thread#6 (ParallelGC)" prio=6 tid=0x00643c00 nid=0x2cdc runnable 

"GC task thread#7 (ParallelGC)" prio=6 tid=0x00644c00 nid=0x22f8 runnable 

"VM Periodic Task Thread" prio=10 tid=0x49e3c800 nid=0x3014 waiting on condition 

JNI global references: 1435
{code}
Comment 13 Richard Opalka 2012-10-15 13:32:44 UTC 
Seems wrong snapshot was used.

Both 
 - "pool-3-thread-1" prio=6
 - "pool-3-thread-2" prio=6

should be:
 - "appclient-output-processing-daemon-1" daemon prio=6
 - "appclient-output-processing-daemon-2" daemon prio=6

Can you build Shared Test Suite SNAPSHOT locally and give it a try?
Comment 14 Rostislav Svoboda 2012-10-15 14:37:16 UTC 
Tests with custom build of Shared Test Suite ended as run with online snapshot. Changes done in r16866 didn't fix the problem.

It seems that either appclient, MSC or XNIO are creators of that pool in stacktrace
Comment 15 Rostislav Svoboda 2012-10-15 14:51:55 UTC 
Notes:

* Executing just org.jboss.test.ws.jaxws.samples.webserviceref.WebServiceRefClientTestCase shows the problem.
* Using Process Explorer to see more details about orphan processes - http://technet.microsoft.com/en-us/sysinternals/bb896653.aspx
Comment 16 Rostislav Svoboda 2012-10-16 08:52:01 UTC 
jaxws-samples-webserviceref-appclient.jar.log-1350311633083 from modules\testsuite\shared-tests\target\appclient-logs

{code}
Calling w:\workspace\eap-60-jbossws-testsuite-alpha-win\jboss-eap-6.0\bin\appclient.conf.bat
10:33:53,625 INFO  [org.jboss.modules] JBoss Modules version 1.1.3.GA-redhat-1
10:33:53,735 INFO  [org.jboss.msc] JBoss MSC version 1.0.2.GA-redhat-2
10:33:53,794 INFO  [org.jboss.as] JBAS015899: JBoss EAP 6.0.1.ER2 (AS 7.1.3.Final-redhat-2) starting
10:33:54,417 INFO  [org.jboss.as.logging] JBAS011502: Removing bootstrap log handlers
10:33:54,419 INFO  [org.jboss.as.security] (ServerService Thread Pool -- 12) JBAS013171: Activating Security Subsystem
10:33:54,420 INFO  [org.jboss.as.naming] (ServerService Thread Pool -- 11) JBAS011800: Activating Naming Subsystem
10:33:54,421 INFO  [org.jboss.as.webservices] (ServerService Thread Pool -- 14) JBAS015537: Activating WebServices Extension
10:33:54,423 INFO  [org.jboss.as.security] (MSC service thread 1-6) JBAS013170: Current PicketBox version=4.0.13.Final-redhat-1
10:33:54,433 INFO  [org.jboss.as.naming] (MSC service thread 1-11) JBAS011802: Starting Naming Service
10:33:54,432 INFO  [org.xnio] (MSC service thread 1-10) XNIO Version 3.0.6.GA-redhat-1
10:33:54,440 INFO  [org.xnio.nio] (MSC service thread 1-10) XNIO NIO Implementation Version 3.0.6.GA-redhat-1
10:33:54,447 INFO  [org.jboss.remoting] (MSC service thread 1-10) JBoss Remoting version 3.2.8.SP1-redhat-1
10:33:54,516 INFO  [org.jboss.as.remoting] (MSC service thread 1-2) JBAS017100: Listening on 127.0.0.1:4448
10:33:54,523 INFO  [org.jboss.as] (Controller Boot Thread) JBAS015874: JBoss EAP 6.0.1.ER2 (AS 7.1.3.Final-redhat-2) started in 1206ms - Started 58 of 63 services (5 services are passive or on-demand)
10:33:54,532 INFO  [org.jboss.as.server.deployment] (MSC service thread 1-5) JBAS015876: Starting deployment of "jaxws-samples-webserviceref-appclient.ear"
10:33:54,593 INFO  [org.jboss.as.server.deployment] (MSC service thread 1-13) JBAS015876: Starting deployment of "jaxws-samples-webserviceref-appclient.jar"
10:33:54,896 INFO  [org.jboss.as.server] (Thread-33) JBAS018559: Deployed "jaxws-samples-webserviceref-appclient.ear"
10:33:55,423 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:55,604 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:55,687 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:55,698 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:55,786 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:55,852 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:55,865 INFO  [org.jboss.test.ws.jaxws.samples.webserviceref.EndpointClientOne] (Thread-34) echo: Hello World!
10:33:55,937 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,006 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,012 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,044 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,147 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,152 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,174 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,275 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,280 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,299 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,402 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,407 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,424 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,480 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,534 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,598 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
10:33:56,660 INFO  [org.apache.cxf.service.factory.ReflectionServiceFactoryBean] (Thread-34) Creating Service {http://org.jboss.ws/wsref}EndpointService from WSDL: jar:file:/w:/workspace/eap-60-jbossws-testsuite-alpha-win/jboss-eap-6.0/appclient/tmp/vfs/deploymentb259c0c1fd85a234/jaxws-samples-webserviceref-appclient.jar-ffa2d01805f05e68/jaxws-samples-webserviceref-appclient.jar!/META-INF/wsdl/Endpoint.wsdl
TEST START
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@cdf3c2
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@1a072a6
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@fd2b1
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@7b6617
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@104f889
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@dc93be
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@ea5d87
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@5e43ee
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@121c7d6
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@607135
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@18532dc
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@17d56b
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@cd429b
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@4947d3
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@1d91382
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@1c46bab
Testing: org.apache.cxf.jaxws.JaxWsClientProxy@1355a47
TEST END
10:33:56,959 INFO  [org.jboss.as.logging] JBAS011503: Restored bootstrap log handlers
10:33:56,970 INFO  [org.jboss.as.server.deployment] JBAS015877: Stopped deployment jaxws-samples-webserviceref-appclient.jar in 16ms
10:33:56,972 INFO  [org.jboss.as.server.deployment] JBAS015877: Stopped deployment jaxws-samples-webserviceref-appclient.ear in 21ms
10:33:56,974 INFO  [org.jboss.as] JBAS015950: JBoss EAP 6.0.1.ER2 (AS 7.1.3.Final-redhat-2) stopped in 13ms
{code}
Comment 17 Richard Opalka 2012-10-16 08:59:17 UTC 
I was not able to reproduce the thread dump that is associated with this JIRA on Linux OS.
Reassigning to Jim because he has Windows machine and could reproduce the problem.
Comment 18 Anne-Louise Tangring 2012-10-25 14:46:18 UTC 
This issue is not a blocker nor a critical for EAP 6.0.1. Thus it is moved to TBD EAP 6 to be triaged for the next EAP 6.x release.
Comment 19 Jim Ma 2012-10-26 01:39:28 UTC 
Verified this issue yesterday and it's the issue in the test , and nothing to do with EAP6 code base. The appclient process started by the test WebServiceRefClientTestCase is not terminated properly on windows platform.
Comment 20 Anne-Louise Tangring 2012-11-13 20:54:51 UTC 
Docs QE Status: Removed: NEW
Comment 21 Rostislav Svoboda 2012-12-04 14:14:10 UTC 
This must be fixed for EAP 6.1.0
Comment 22 Jim Ma 2013-01-14 09:35:19 UTC 
Tested this again with lastest jboss7(commit da4af68ed00e48336e7a1ec2e9787d6f7245bf4b) and jbossws-cxf(Revision: 17235), this issue is gone. Looks the recent change in as or appclient resolved it.
Comment 23 Rostislav Svoboda 2013-02-22 12:10:00 UTC 
Checked with EAP 6.1.0 DR4, JBossWS CXT TS hangs no more.