Bug 900524 (JBPAPP6-911)

Summary: CLONE - Remote EJB clients hanging after EJBClient.createSession when using DIST
Product: [JBoss] JBoss Enterprise Application Platform 6 Reporter: Radoslav Husar <rhusar>
Component: Clustering, EJBAssignee: Jaikiran Pai <jpai>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: high Docs Contact:
Priority: high    
Version: 6.0.0CC: dimitris, jkudrnac, jpai, paul.ferraro, rhusar, sgilda, simone.gotti
Target Milestone: ---   
Target Release: EAP 6.0.1   
Hardware: Unspecified   
OS: Unspecified   
URL: http://jira.jboss.org/jira/browse/JBPAPP6-911
Whiteboard: eap601candidate
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-10-22 04:45:42 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 900611    

Description Radoslav Husar 2012-05-24 15:33:53 UTC
Affects: Release Notes
project_key: JBPAPP6

Lets keep technical track here AS7-4881.

Comment 1 Radoslav Husar 2012-05-24 15:33:54 UTC
Link: Added: This issue Cloned from AS7-4881


Comment 2 Radoslav Husar 2012-05-24 15:33:54 UTC
Link: Added: This issue is incorporated by JBPAPP-7577


Comment 3 Radoslav Husar 2012-05-24 15:33:55 UTC
Link: Added: This issue relates to AS7-4854


Comment 4 Radoslav Husar 2012-05-24 15:34:17 UTC
Workflow: Removed: GIT Pull Request workflow  Added: jira
Security: Added: Public
Docs QE Status: Added: NEW


Comment 5 Rajesh Rajasekaran 2012-05-24 15:37:09 UTC
Labels: Added: eap6_need_triage


Comment 6 Misty Stanley-Jones 2012-06-01 05:28:03 UTC
Release Notes Docs Status: Added: Not Yet Documented
Affects: Added: Release Notes


Comment 7 Misty Stanley-Jones 2012-06-01 13:35:03 UTC
Release Notes Docs Status: Removed: Not Yet Documented Added: Documented as Known Issue
Release Notes Text: Added: Remote EJB clients sometimes hang after calling method <code>EJBClient.createSession</code> when using DIST mode. The cause of this bug is still under investigation.


Comment 9 Radoslav Husar 2012-06-06 11:45:04 UTC
Link: Added: This issue is related to JBPAPP-8455


Comment 10 Rajesh Rajasekaran 2012-06-06 20:43:29 UTC
Link: Added: This issue is a dependency of JBPAPP-9290


Comment 11 Rajesh Rajasekaran 2012-06-06 20:53:13 UTC
Link: Removed: This issue is incorporated by JBPAPP-7577 


Comment 12 Rajesh Rajasekaran 2012-07-11 19:30:50 UTC
Labels: Removed: eap6_need_triage Added: eap601candidate


Comment 13 Jaikiran Pai 2012-08-06 08:44:51 UTC
Marking this as resolved for EAP 6.0.1 since Paul has fixed the upstream issue AS7-4881

Comment 14 Radoslav Husar 2012-08-07 15:05:33 UTC
Verified in DR1 build, closing.

Comment 15 sgilda 2012-10-04 13:06:32 UTC
Does this need a release note for EAP 6.0.1? 
If so, the issue needs to be re-opened and the release notes flags set (Affects Release Notes, Not Yet Documented).
If not, the issue needs to be re-opened and the release notes flag set to "Release notes not required".

Comment 16 sgilda 2012-10-04 13:33:21 UTC
Ignore my previous comment. :-)

Comment 17 Dana Mison 2012-10-16 06:05:18 UTC
Writer: Added: mistysj


Comment 18 Dana Mison 2012-10-17 22:51:17 UTC
reopening to update release notes (these are still documented as known issues from the previous release)

Comment 19 Dana Mison 2012-10-17 22:52:02 UTC
Writer: Removed: mistysj Added: Darrin


Comment 20 Dana Mison 2012-10-17 23:04:38 UTC
Setting these to "Not Yet Documented" since they required updating from known to resolved issues.

Comment 21 Dana Mison 2012-10-17 23:04:38 UTC
Release Notes Docs Status: Removed: Documented as Known Issue Added: Not Yet Documented


Comment 23 Dana Mison 2012-10-22 04:44:42 UTC
Release Notes Docs Status: Removed: Not Yet Documented Added: Not Required
Release Notes Text: Removed: Remote EJB clients sometimes hang after calling method <code>EJBClient.createSession</code> when using DIST mode. The cause of this bug is still under investigation. 


Comment 25 Dana Mison 2012-10-22 04:58:53 UTC
Release Notes Docs Status: Removed: Not Required Added: Needs More Info


Comment 26 Dana Mison 2012-10-24 02:41:04 UTC
Hi Jaikiran,

Can you provide some clarification of this issue for the EAP6.0.1 release notes.

I followed the related issues and found https://community.jboss.org/message/747160 and https://issues.jboss.org/browse/ISPN-2153 - so maybe Paul Ferraro might be the right man to ask?

Specifically I need clarification on:

1 - Was this specific to EJB clients or what that just the reported situation?  Would this have occurred in other scenario?

2 - The root cause of this would seem to be that the KeyAffinityFactory was creating all KAS services in the same thread.  Not sure if this meant that each key request was simply getting delayed (and thus appeared hung) or if it was some kind of lock issue that resulted ?

3 - The fix for this also isn't clear, is this now using multiple threads or is the "locking" fixed?  (assuming it was a lock issue)

Thanks.

Comment 27 Paul Ferraro 2012-10-30 17:58:09 UTC
1. This was specific to any SFSB creation (regardless of whether client is remote or local) where a DIST mode cache was used.
2. The root cause was my misunderstanding of how the executor supplied to KAS was used.  I assumed that the thread was used only to pre-generate SFSB UUIDs as needed - and that a single thread could service all SFSBs.  On the contrary, KAS uses this thread for the lifetime of the KAS, so it cannot be shared across multiple KASes.  Consequently, DIST mode only worked correctly if your application had only 1 SFSB.  Any subsequent SFSBs would hang waiting for a free thread that would never be available!
3. Now, each KAS gets it's own thread, instead of trying to share a thread (which is not possible).

Comment 28 sgilda 2012-10-30 18:03:41 UTC
Thanks Paul!

Comment 29 Tom WELLS 2012-11-07 04:30:41 UTC
Release Notes Docs Status: Removed: Needs More Info Added: Not Yet Documented


Comment 30 Anne-Louise Tangring 2012-11-13 20:07:47 UTC
Release Notes Docs Status: Removed: Not Yet Documented 
Writer: Removed: Darrin 
Docs QE Status: Removed: NEW 


Comment 31 Jitka Kozana 2013-02-19 13:38:19 UTC
This issue was left open because of documentation after JIRA -> BZ migration and is already verified. 
Therefore closing as verified.