Bug 1223708

Created attachment 1028055 [details]
Direct memory report

Problem: "java.lang.OutOfMemoryError: Direct buffer memory" was thrown during connector performance testing, see attaches 'exception.txt'.

The problem was hidden by [1] which was fixed in 6.4.1.CP.CR2, therefore this is not a regression.

Performance connectors testing
 * EAP is started with configuration standalone-ha.xml (see attachment)
   * please notice http connectors especialy, nio2 is set
 * EAP is requested from 4 other nodes by commands like (request are no-keep alive)
   ab -n 10000 -c 256 -Z ECDHE-RSA-DES-CBC3-SHA <https://...>
   This command is executed ~ 60 times from each node.

 * Exception was thrown after ~ 50minutes in described scenario 
 * I tried to increate direct buffer memory to 8G ( -XX:MaxDirectMemorySize=8G) and exception was thrown later only (after ~ 150 minutes).
 * I monitored direct buffer memory during scenario with increased memory by [2]. For details see attached 'direct-buffer-memory-monitor.log' and 'server.log'.


[1] https://bugzilla.redhat.com/show_bug.cgi?id=1200276
[2] https://blogs.oracle.com/alanb/resource/MonBuffers.java
[3] EAP JAVA_OPTS
      -XX:+UseCompressedOops 
      -verbose:gc 
      -Xloggc:"/tmp/hudson/jboss-eap/standalone/log/gc.log" 
      -XX:+PrintGCDetails 
      -XX:+PrintGCDateStamps 
      -XX:+UseGCLogFileRotation 
      -XX:NumberOfGCLogFiles=5 
      -XX:GCLogFileSize=3M 
      -XX:-TraceClassUnloading 
      -server -Xms5g -Xmx5g -XX:MaxPermSize=512m -Xss1024k 
      -Dorg.jboss.resolver.warning=true  
      -Dsun.rmi.dgc.client.gcInterval=3600000 
      -Dsun.rmi.dgc.server.gcInterval=3600000 
      -Djgroups.udp.ip_ttl=1 
      -Djava.net.preferIPv4Stack=true 
      -Djboss.modules.system.pkgs=org.jboss.byteman 
      -Dsf.pid=WvphqJBs824awiZM