Bug 1062565

Summary: Rare 'java.lang.OutOfMemoryError: GC overhead limit exceeded' running AdvancedLdapLoginModuleTestCase
Product: [JBoss] JBoss Enterprise Application Platform 6 Reporter: Carlo de Wolf <cdewolf>
Component: TestsuiteAssignee: Ondřej Žižka <ozizka>
Status: CLOSED CURRENTRELEASE QA Contact: Pavel Jelinek <pjelinek>
Severity: high Docs Contact:
Priority: unspecified    
Version: 6.2.0, 6.3.0CC: cdewolf, dpospisi, kkhan, myarboro, smumford
Target Milestone: ER2   
Target Release: EAP 6.3.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
: 1090309 (view as bug list) Environment:
Last Closed: 2014-06-28 15:24:45 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1078958, 1085709    
Bug Blocks: 1090309    
Attachments:
Description Flags
6.2.0 test log
none
6.2.1-CR4 test log none

Description Carlo de Wolf 2014-02-07 10:31:00 UTC
In care (and unknown) conditions Apache DS goes in an infinite loop with:
ERROR [org.apache.directory.shared.asn1.ber.grammar.AbstractGrammar] (NioDatagramAcceptor-1) ERR_00001_BAD_TRANSITION_FROM_STATE Bad transition from state START_STATE, tag 0x6C

This results in Maven surefire going OutOfMemory.

Comment 1 Carlo de Wolf 2014-02-07 10:34:09 UTC
Created attachment 860432 [details]
6.2.0 test log

Comment 2 Carlo de Wolf 2014-02-07 10:34:47 UTC
Created attachment 860433 [details]
6.2.1-CR4 test log

Comment 3 Dominik Pospisil 2014-02-14 20:52:28 UTC
The infinite loop is caused by wrong exception handling in org.apache.directory.server.kerberos.protocol.codec.KerberosDecoder. The issue seems to be fixed in latest ApacheDS release (2.0.0.M15). Will retest and confirm the fix.

Comment 4 Dominik Pospisil 2014-02-24 09:42:30 UTC
When the ApacheDS is updated to 2.0.0.M15, the OOME is gone. However, we are hitting another issue with kerberos pre-auth:
https://issues.apache.org/jira/browse/DIRKRB-99

Comment 5 Dominik Pospisil 2014-03-21 11:47:50 UTC
Unfortunatelly, upgrading ApacheDS solves OOME however it exposes a bug in latest OpenJDK which makes it crash on SPNEGOLoginModuleTestCase.

Comment 6 Kabir Khan 2014-03-31 11:25:38 UTC
https://github.com/jbossas/jboss-eap/pull/1147

Comment 7 Pavel Jelinek 2014-04-15 14:08:15 UTC
Verification blocked by https://bugzilla.redhat.com/show_bug.cgi?id=1085709 
Will be verified in ER2.

Comment 8 Pavel Jelinek 2014-04-30 14:52:24 UTC
Didn't occured in EAP 6.3.0.ER2 so far again.