At a graceful server shutdown, we are seeing the following NPE: 04:51:06,926 ERROR [org.jboss.as.ejb3] (EJB default - 8) JBAS014251: Exception while generating session id for component RemoteStatefulSBImpl with invocation id: 29101 on channel Channel ID 1c31aeb8 (inbound) of Remoting connection 411c6c59 to /10.16.90.52:52326: java.lang.NullPointerException: Null keys are not supported! at org.infinispan.CacheImpl.assertKeyNotNull(CacheImpl.java:197) at org.infinispan.CacheImpl.assertKeyValueNotNull(CacheImpl.java:202) at org.infinispan.CacheImpl.putInternal(CacheImpl.java:781) at org.infinispan.CacheImpl.put(CacheImpl.java:777) at org.infinispan.DecoratedCache.put(DecoratedCache.java:320) at org.infinispan.AbstractDelegatingCache.put(AbstractDelegatingCache.java:308) at org.jboss.as.clustering.ejb3.cache.backing.infinispan.InfinispanBackingCacheEntryStore$1.invoke(InfinispanBackingCacheEntryStore.java:174) at org.jboss.as.clustering.ejb3.cache.backing.infinispan.InfinispanBackingCacheEntryStore$1.invoke(InfinispanBackingCacheEntryStore.java:171) at org.jboss.as.clustering.infinispan.invoker.SimpleCacheInvoker.invoke(SimpleCacheInvoker.java:34) at org.jboss.as.clustering.infinispan.invoker.BatchCacheInvoker.invoke(BatchCacheInvoker.java:48) at org.jboss.as.clustering.infinispan.invoker.RetryingCacheInvoker.invoke(RetryingCacheInvoker.java:81) at org.jboss.as.clustering.ejb3.cache.backing.infinispan.InfinispanBackingCacheEntryStore.insert(InfinispanBackingCacheEntryStore.java:178) at org.jboss.as.ejb3.cache.impl.backing.SerializationGroupMemberContainer.insert(SerializationGroupMemberContainer.java:304) at org.jboss.as.ejb3.cache.impl.backing.SerializationGroupMemberContainer.insert(SerializationGroupMemberContainer.java:51) at org.jboss.as.ejb3.cache.impl.backing.PassivatingBackingCacheImpl.create(PassivatingBackingCacheImpl.java:122) at org.jboss.as.ejb3.cache.impl.GroupAwareCache.create(GroupAwareCache.java:67) at org.jboss.as.ejb3.cache.impl.GroupAwareCache.create(GroupAwareCache.java:41) at org.jboss.as.ejb3.component.stateful.StatefulSessionComponent.createSession(StatefulSessionComponent.java:239) at org.jboss.as.ejb3.remote.protocol.versionone.SessionOpenRequestHandler$SessionIDGeneratorTask.run(SessionOpenRequestHandler.java:146) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) [rt.jar:1.6.0_45] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) [rt.jar:1.6.0_45] at java.util.concurrent.FutureTask.run(FutureTask.java:138) [rt.jar:1.6.0_45] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) [rt.jar:1.6.0_45] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) [rt.jar:1.6.0_45] at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_45] at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.0.Final-redhat-1.jar:2.1.0.Final-redhat-1] Cache: DIST SYNC. Nothing to be seen in the client log (the client log is already closed at the time of this error). After this NPE, we are seeing a few of BZ 900999. Link to server log: https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/eap-6x-failover-ejb-ejbremote-netDown-dist-sync/21/artifact/report/config/jboss-perf18/server.log
Forgot to add: this is EAP 6.1.1.ER3.
Still seeing this with EAP 6.1.1.ER7. Only happens in one test case: https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/eap-6x-failover-ejb-ejbremote-netDown-dist-sync/24/
Seen again in EAP 6.2.0.CR3 during the same setup. Link to sever logs: https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/eap-6x-failover-ejb-ejbremote-netDown-dist-sync/34/artifact/report/config/jboss-perf20/server.log https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/eap-6x-failover-ejb-ejbremote-netDown-dist-sync/34/artifact/report/config/jboss-perf21/server.log
We need to file an upstream bug with Infinispan. The KeyAffinityService is returning a null key. This should never happen.
Actually, the KeyAffinityService returns a null key because the service is stopped or is stopping - so this bug is related to clean shutdown of the EJB subsystem, a feature that is not yet implemented.
The RFE to implement graceful shutdown is https://issues.jboss.org/browse/EAP6-7
Marking for exclusion from Release Notes documentation as deferred.
This bug pertains to clean shutdown which is not scheduled to be implemented in EAP 6.x - and is targeted to be addressed in 7.0. Setting resolution to WONTFIX.
Moved to https://issues.jboss.org/browse/EAP7-86
Jason Greene <jason.greene> updated the status of jira EAP7-86 to Resolved
Radim Hatlapatka <rhatlapa> updated the status of jira EAP7-86 to Reopened