org.jboss.test.ws.publish.EndpointPublishTestCase.testEndpointPublish -- NEW Minor, only one failure in whole tested matrix Error: expected:<[1]> but was:<[org.apache.cxf.service.factory.ServiceConstructionException: Failed to create service.]> https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-WS/job/eap-60-jbossws-testsuite-rhel/37/jdk=ibm17,label_exp=RHEL5%26%26x86_64/testReport/org.jboss.test.ws.publish/EndpointPublishTestCase/testEndpointPublish/ https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-WS/job/eap-60-jbossws-testsuite-rhel/37/testReport/ Relevant server log part: 0m[31m12:07:50,160 ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/ep-publish-test].[pattern]] (http-/127.0.0.1:8080-9) JBWEB000235: Allocate exception for servlet pattern: javax.xml.ws.WebServiceException: JBWS024032: Cannot obtain endpoint jboss.ws:context=ep-publish-test,endpoint=pattern at org.jboss.wsf.stack.cxf.transport.ServletHelper.initServiceEndpoint(ServletHelper.java:97) at org.jboss.wsf.stack.cxf.transport.ServletHelper.initEndpoint(ServletHelper.java:71) at org.jboss.wsf.stack.cxf.CXFServletExt.loadBus(CXFServletExt.java:67) at org.jboss.wsf.stack.cxf.CXFServletExt.init(CXFServletExt.java:61) at org.jboss.wsf.spi.deployment.WSFServlet.init(WSFServlet.java:57) [jbossws-spi-2.1.2.Final-redhat-1.jar:2.1.2.Final-redhat-1] at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1194) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:950) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:151) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at java.lang.Thread.run(Thread.java:780) [vm.jar:1.7.0] [0m[31m12:07:50,176 ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/ep-publish-test].[pattern]] (http-/127.0.0.1:8080-9) JBWEB000235: Allocate exception for servlet pattern: javax.xml.ws.WebServiceException: JBWS024032: Cannot obtain endpoint jboss.ws:context=ep-publish-test,endpoint=pattern at org.jboss.wsf.stack.cxf.transport.ServletHelper.initServiceEndpoint(ServletHelper.java:97) at org.jboss.wsf.stack.cxf.transport.ServletHelper.initEndpoint(ServletHelper.java:71) at org.jboss.wsf.stack.cxf.CXFServletExt.loadBus(CXFServletExt.java:67) at org.jboss.wsf.stack.cxf.CXFServletExt.init(CXFServletExt.java:61) at org.jboss.wsf.spi.deployment.WSFServlet.init(WSFServlet.java:57) [jbossws-spi-2.1.2.Final-redhat-1.jar:2.1.2.Final-redhat-1] at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1194) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:950) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:151) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) [jbossweb-7.2.0.Final-redhat-1.jar:7.2.0.Final-redhat-1] at java.lang.Thread.run(Thread.java:780) [vm.jar:1.7.0] [0m[31m12:07:50,183 ERROR [stderr] (http-/127.0.0.1:8080-5) javax.xml.ws.WebServiceException: org.apache.cxf.service.factory.ServiceConstructionException: Failed to create service. [0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.jaxws.ServiceImpl.<init>(ServiceImpl.java:149) [0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.jboss.wsf.stack.cxf.client.ProviderImpl$JBossWSServiceImpl.<init>(ProviderImpl.java:479) [0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.jboss.wsf.stack.cxf.client.ProviderImpl.createServiceDelegate(ProviderImpl.java:165) [0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) at javax.xml.ws.Service.<init>(Service.java:57) [0m[31m12:07:50,184 ERROR [stderr] (http-/127.0.0.1:8080-5) at javax.xml.ws.Service.create(Service.java:687) [0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.jboss.test.ws.publish.EndpointPublishServlet.invoke(EndpointPublishServlet.java:171) [0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.jboss.test.ws.publish.EndpointPublishServlet.doGet(EndpointPublishServlet.java:97) [0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) [0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [0m[31m12:07:50,185 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) [0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) [0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) [0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) [0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) [0m[31m12:07:50,186 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) [0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) [0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) [0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) [0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856) [0m[31m12:07:50,187 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653) [0m[31m12:07:50,188 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) [0m[31m12:07:50,188 ERROR [stderr] (http-/127.0.0.1:8080-5) at java.lang.Thread.run(Thread.java:780) [0m[31m12:07:50,188 ERROR [stderr] (http-/127.0.0.1:8080-5) Caused by: org.apache.cxf.service.factory.ServiceConstructionException: Failed to create service. [0m[31m12:07:50,189 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.wsdl11.WSDLServiceFactory.<init>(WSDLServiceFactory.java:100) [0m[31m12:07:50,189 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.jaxws.ServiceImpl.initializePorts(ServiceImpl.java:203) [0m[31m12:07:50,189 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.jaxws.ServiceImpl.<init>(ServiceImpl.java:147) [0m[31m12:07:50,189 ERROR [stderr] (http-/127.0.0.1:8080-5) ... 21 more [0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) Caused by: javax.wsdl.WSDLException: WSDLException: faultCode=PARSER_ERROR: com.ctc.wstx.exc.WstxParsingException: Unexpected close tag </body>; expected </HR>. [0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) at javax.xml.stream.SerializableLocation@94fabdf0 [0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.wsdl11.WSDLManagerImpl.loadDefinition(WSDLManagerImpl.java:243) [0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.wsdl11.WSDLManagerImpl.getDefinition(WSDLManagerImpl.java:192) [0m[31m12:07:50,190 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.wsdl11.WSDLServiceFactory.<init>(WSDLServiceFactory.java:98) [0m[31m12:07:50,191 ERROR [stderr] (http-/127.0.0.1:8080-5) ... 23 more [0m[31m12:07:50,191 ERROR [stderr] (http-/127.0.0.1:8080-5) Caused by: com.ctc.wstx.exc.WstxParsingException: Unexpected close tag </body>; expected </HR>. [0m[31m12:07:50,191 ERROR [stderr] (http-/127.0.0.1:8080-5) at javax.xml.stream.SerializableLocation@94fabdf0 [0m[31m12:07:50,191 ERROR [stderr] (http-/127.0.0.1:8080-5) at com.ctc.wstx.sr.StreamScanner.constructWfcException(StreamScanner.java:606) [0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) at com.ctc.wstx.sr.StreamScanner.throwParseError(StreamScanner.java:479) [0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) at com.ctc.wstx.sr.StreamScanner.throwParseError(StreamScanner.java:464) [0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) at com.ctc.wstx.sr.BasicStreamReader.reportWrongEndElem(BasicStreamReader.java:3283) [0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) at com.ctc.wstx.sr.BasicStreamReader.readEndElem(BasicStreamReader.java:3210) [0m[31m12:07:50,192 ERROR [stderr] (http-/127.0.0.1:8080-5) at com.ctc.wstx.sr.BasicStreamReader.nextFromTree(BasicStreamReader.java:2829) [0m[31m12:07:50,193 ERROR [stderr] (http-/127.0.0.1:8080-5) at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1072) [0m[31m12:07:50,193 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.staxutils.StaxUtils.readDocElements(StaxUtils.java:1250) [0m[31m12:07:50,193 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.staxutils.StaxUtils.readDocElements(StaxUtils.java:1144) [0m[31m12:07:50,193 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.staxutils.StaxUtils.read(StaxUtils.java:1071) [0m[31m12:07:50,194 ERROR [stderr] (http-/127.0.0.1:8080-5) at org.apache.cxf.wsdl11.WSDLManagerImpl.loadDefinition(WSDLManagerImpl.java:234) [0m[31m12:07:50,194 ERROR [stderr] (http-/127.0.0.1:8080-5) ... 25 more
From the server log and test log, the most possible cause is the classloader which loads the EndpointRegistryFactory in ServeltHelper is not the classloader in EndpointRegistryDeploymentAspect. I don't think this classloader(the jbossws.common mdoule's module classloader) can be changed by module reload or module/module classloader is gc-ed. But I am not sure if this is some strange ibm jdk's jdk behaviour. I think we can add some log to look at the classloader name to make it clear.
Created attachment 741061 [details] jbossws-common patch jar
Created attachment 741067 [details] jbossws-cxf-server patch jar
Hi Rostislav , Can you please patched these two jars to EAP6.1 and get this test run again ? Let's see if this is cause of the classloader change. Thanks !
Cloning my jobs, will be using 4.1.3.snapshot + patches from BZ 956639
Issue not replicated yet, running again.
We didn't hit this issue again for several months. Closing.