Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 956639

Summary:

EndpointPublishTestCase testEndpointPublish intermittent failure, EAP 6.1.0

Product:

[JBoss] JBoss Enterprise Application Platform 6

Reporter:

Rostislav Svoboda <rsvoboda>

Component:

Web Services

Assignee:

Jim Ma <ema>

Status:

CLOSED WONTFIX

QA Contact:

Severity:

low

Docs Contact:

Priority:

unspecified

Version:

6.1.0

CC:

ema

Target Milestone:

---

Target Release:

---

Hardware:

Unspecified

OS:

Unspecified

Whiteboard:

Fixed In Version:

Doc Type:

Bug Fix

Doc Text:

Story Points:

---

Clone Of:

Environment:

Last Closed:

2013-09-20 12:52:37 UTC

Type:

Bug

Regression:

---

Mount Type:

---

Documentation:

---

CRM:

Verified Versions:

Category:

---

oVirt Team:

---

RHEL 7.3 requirements from Atomic Host:

Cloudforms Team:

---

Target Upstream Version:

Embargoed:

Attachments:

Description	Flags
jbossws-common patch jar	none
jbossws-cxf-server patch jar	none

Description Rostislav Svoboda 2013-04-25 10:47:56 UTC

org.jboss.test.ws.publish.EndpointPublishTestCase.testEndpointPublish -- NEW
  Minor, only one failure in whole tested matrix

Error:
expected:<[1]> but was:<[org.apache.cxf.service.factory.ServiceConstructionException: Failed to create service.]>


https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-WS/job/eap-60-jbossws-testsuite-rhel/37/jdk=ibm17,label_exp=RHEL5%26%26x86_64/testReport/org.jboss.test.ws.publish/EndpointPublishTestCase/testEndpointPublish/
https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-WS/job/eap-60-jbossws-testsuite-rhel/37/testReport/

Relevant server log part:
0m[31m12:07:50,160 ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/ep-publish-test].[pattern]] (http-/127.0.0.1:8080-9) JBWEB000235: Allocate exception for servlet pattern: javax.xml.ws.WebServiceException: JBWS024032: Cannot obtain endpoint jboss.ws:context=ep-publish-test,endpoint=pattern
	at org.jboss.wsf.stack.cxf.transport.ServletHelper.initServiceEndpoint(ServletHelper.java:97)
	at org.jboss.wsf.stack.cxf.transport.ServletHelper.initEndpoint(ServletHelper.java:71)
	at org.jboss.wsf.stack.cxf.CXFServletExt.loadBus(CXFServletExt.java:67)
	at org.jboss.wsf.stack.cxf.CXFServletExt.init(CXFServletExt.java:61)
	at org.jboss.wsf.spi.deployment.WSFServlet.init(WSFServlet.java:57) [jbossws-spi-2.1.2.Final-redhat-1.jar:2.1.2.Final-redhat-1]
	at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1194) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:950) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:151) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at java.lang.Thread.run(Thread.java:780) [vm.jar:1.7.0]

[0m[31m12:07:50,176 ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/ep-publish-test].[pattern]] (http-/127.0.0.1:8080-9) JBWEB000235: Allocate exception for servlet pattern: javax.xml.ws.WebServiceException: JBWS024032: Cannot obtain endpoint jboss.ws:context=ep-publish-test,endpoint=pattern
	at org.jboss.wsf.stack.cxf.transport.ServletHelper.initServiceEndpoint(ServletHelper.java:97)
	at org.jboss.wsf.stack.cxf.transport.ServletHelper.initEndpoint(ServletHelper.java:71)
	at org.jboss.wsf.stack.cxf.CXFServletExt.loadBus(CXFServletExt.java:67)
	at org.jboss.wsf.stack.cxf.CXFServletExt.init(CXFServletExt.java:61)
	at org.jboss.wsf.spi.deployment.WSFServlet.init(WSFServlet.java:57) [jbossws-spi-2.1.2.Final-redhat-1.jar:2.1.2.Final-redhat-1]
	at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1194) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:950) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:151) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1]
	at java.lang.Thread.run(Thread.java:780) [vm.jar:1.7.0]

[0m[31m12:07:50,183 ERROR [stderr] (http-/127.0.0.1:8080-5) javax.xml.ws.WebServiceException: org.apache.cxf.service.factory.ServiceConstructionException: Failed to create service.
[0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.jaxws.ServiceImpl.<init>(ServiceImpl.java:149)
[0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.jboss.wsf.stack.cxf.client.ProviderImpl$JBossWSServiceImpl.<init>(ProviderImpl.java:479)
[0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.jboss.wsf.stack.cxf.client.ProviderImpl.createServiceDelegate(ProviderImpl.java:165)
[0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at javax.xml.ws.Service.<init>(Service.java:57)
[0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at javax.xml.ws.Service.create(Service.java:687)
[0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.jboss.test.ws.publish.EndpointPublishServlet.invoke(EndpointPublishServlet.java:171)
[0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.jboss.test.ws.publish.EndpointPublishServlet.doGet(EndpointPublishServlet.java:97)
[0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:734)
[0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
[0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295)
[0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)
[0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230)
[0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149)
[0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169)
[0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145)
[0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97)
[0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102)
[0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336)
[0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
[0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653)
[0m[31m12:07:50,188 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920)
[0m[31m12:07:50,188 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at java.lang.Thread.run(Thread.java:780)
[0m[31m12:07:50,188 ERROR [stderr] (http-/127.0.0.1:8080-5) Caused by: org.apache.cxf.service.factory.ServiceConstructionException: Failed to create service.
[0m[31m12:07:50,189 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.wsdl11.WSDLServiceFactory.<init>(WSDLServiceFactory.java:100)
[0m[31m12:07:50,189 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.jaxws.ServiceImpl.initializePorts(ServiceImpl.java:203)
[0m[31m12:07:50,189 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.jaxws.ServiceImpl.<init>(ServiceImpl.java:147)
[0m[31m12:07:50,189 ERROR [stderr] (http-/127.0.0.1:8080-5) 	... 21 more
[0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) Caused by: javax.wsdl.WSDLException: WSDLException: faultCode=PARSER_ERROR: com.ctc.wstx.exc.WstxParsingException: Unexpected close tag </body>; expected </HR>.
[0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5)  at javax.xml.stream.SerializableLocation@94fabdf0
[0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.wsdl11.WSDLManagerImpl.loadDefinition(WSDLManagerImpl.java:243)
[0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.wsdl11.WSDLManagerImpl.getDefinition(WSDLManagerImpl.java:192)
[0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.wsdl11.WSDLServiceFactory.<init>(WSDLServiceFactory.java:98)
[0m[31m12:07:50,191 ERROR [stderr] (http-/127.0.0.1:8080-5) 	... 23 more
[0m[31m12:07:50,191 ERROR [stderr] (http-/127.0.0.1:8080-5) Caused by: com.ctc.wstx.exc.WstxParsingException: Unexpected close tag </body>; expected </HR>.
[0m[31m12:07:50,191 ERROR [stderr] (http-/127.0.0.1:8080-5)  at javax.xml.stream.SerializableLocation@94fabdf0
[0m[31m12:07:50,191 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at com.ctc.wstx.sr.StreamScanner.constructWfcException(StreamScanner.java:606)
[0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at com.ctc.wstx.sr.StreamScanner.throwParseError(StreamScanner.java:479)
[0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at com.ctc.wstx.sr.StreamScanner.throwParseError(StreamScanner.java:464)
[0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at com.ctc.wstx.sr.BasicStreamReader.reportWrongEndElem(BasicStreamReader.java:3283)
[0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at com.ctc.wstx.sr.BasicStreamReader.readEndElem(BasicStreamReader.java:3210)
[0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at com.ctc.wstx.sr.BasicStreamReader.nextFromTree(BasicStreamReader.java:2829)
[0m[31m12:07:50,193 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1072)
[0m[31m12:07:50,193 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.staxutils.StaxUtils.readDocElements(StaxUtils.java:1250)
[0m[31m12:07:50,193 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.staxutils.StaxUtils.readDocElements(StaxUtils.java:1144)
[0m[31m12:07:50,193 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.staxutils.StaxUtils.read(StaxUtils.java:1071)
[0m[31m12:07:50,194 ERROR [stderr] (http-/127.0.0.1:8080-5) 	at org.apache.cxf.wsdl11.WSDLManagerImpl.loadDefinition(WSDLManagerImpl.java:234)
[0m[31m12:07:50,194 ERROR [stderr] (http-/127.0.0.1:8080-5) 	... 25 more

Comment 1 Jim Ma 2013-04-28 06:27:09 UTC

From the server log and test log, the most possible cause is the classloader which loads the EndpointRegistryFactory in ServeltHelper is not the classloader in EndpointRegistryDeploymentAspect. I don't think this classloader(the jbossws.common mdoule's module classloader) can be changed by module reload or module/module classloader is gc-ed. But I am not sure if this is some strange  ibm jdk's jdk behaviour. I think we can add some log to look at the classloader name to make it clear.

Comment 2 Jim Ma 2013-04-28 07:01:55 UTC

Created attachment 741061 [details]
jbossws-common patch jar

Comment 3 Jim Ma 2013-04-28 07:02:27 UTC

Created attachment 741067 [details]
jbossws-cxf-server patch jar

Comment 4 Jim Ma 2013-04-28 07:05:08 UTC

Hi Rostislav , Can you please patched these two jars to EAP6.1 and get this test run again ? Let's see if this is cause of the classloader change. Thanks !

Comment 5 Rostislav Svoboda 2013-04-29 12:59:37 UTC

Cloning my jobs, will be using 4.1.3.snapshot + patches from BZ 956639

Comment 6 Rostislav Svoboda 2013-04-30 09:28:56 UTC

Issue not replicated yet, running again.

Comment 8 Rostislav Svoboda 2013-09-20 12:52:37 UTC

We didn't hit this issue again for several months. Closing.