Bug 1034632

Summary: java coredump very rarely when running Satellite 5.6.0
Product: Red Hat Enterprise Linux 6 Reporter: Jan Hutař <jhutar>
Component: java-1.6.0-ibmAssignee: jiri vanek <jvanek>
Status: CLOSED INSUFFICIENT_DATA QA Contact: BaseOS QE - Apps <qe-baseos-apps>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 6.5CC: dbhole
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-10-12 20:05:54 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Jan Hutař 2013-11-26 09:05:03 UTC 
Description of problem:
I have noticed JVM backtraced while I was accessing Red Hat Satellite 5.6.0 frontend API.


Version-Release number of selected component (if applicable):
java-1.6.0-ibm-1.6.0.14.0-1jpp.1.el6_4


How reproducible:
very rarely - seen it for the first time


Steps to Reproduce:
1. Accessing frontend API of Satellite


Actual results:
Backtrace generated, httpd returned "503 Service Temporarily Unavailable"


Expected results:
Should work
Comment 2 Jan Hutař 2013-11-26 09:11:46 UTC 
This appeared in a catalina.out:

Unhandled exception
Type=Bus error vmState=0x00020019
J9Generic_Signal_Number=00000008 Signal_Number=00000007 Error_Value=00000000 Signal_Code=00000002
Handler1=00007FB6D2D1EC80 Handler2=00007FB6D29D7FF0 InaccessibleAddress=00007FB6C5691030
RDI=00007FB6C5691050 RSI=0000000000000000 RAX=00007FB6C5691030 RBX=00007FB6C5691018
RCX=0000000000000092 RDX=0000000000000000 R8=0000000000000020 R9=0101010101010101
R10=00007FB6CC0BBA68 R11=00000036AE883D9E R12=00007FB64C00E400 R13=00007FB6B459C7E0
R14=00007FB6CC96D250 R15=00007FB6C5691018
RIP=00000036AE883D9E GS=0000 FS=0000 RSP=00007FB6B459C708
EFlags=0000000000210206 CS=0033 RBP=00007FB65400F898 ERR=0000000000000006
TRAPNO=000000000000000E OLDMASK=0000000000000000 CR2=00007FB6C5691030
xmm0 402500003f8ccccd (f: 1066192064.000000, d: 1.050000e+01)
xmm1 000000003f400000 (f: 1061158912.000000, d: 5.242822e-315)
xmm2 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm3 bff0000000000000 (f: 0.000000, d: -1.000000e+00)
xmm4 4040404040404040 (f: 1077952512.000000, d: 3.250196e+01)
xmm5 5b5b5b5b5b5b5b5b (f: 1532713856.000000, d: 1.213625e+132)
xmm6 2020202020202020 (f: 538976256.000000, d: 6.013470e-154)
xmm7 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm8 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
Module=/lib64/libc.so.6
Module_base_address=00000036AE800000
Target=2_40_20130704_155156 (Linux 2.6.32-431.el6.x86_64)
CPU=amd64 (4 logical CPUs) (0xeee74000 RAM)
----------- Stack Backtrace -----------
(0x00000036AE883D9E [libc.so.6+0x83d9e])
(0x00007FB6D1610497 [libj9gc24.so+0x5e497])
(0x00007FB6D1610505 [libj9gc24.so+0x5e505])
(0x00007FB6D15D5BE1 [libj9gc24.so+0x23be1])
(0x00007FB6D2D1DAE1 [libj9vm24.so+0x13ae1])
(0x00007FB6D2D1DF83 [libj9vm24.so+0x13f83])
(0x00007FB6D2D1D9DB [libj9vm24.so+0x139db])
(0x00007FB6D1C1000B [libj9jit24.so+0x3ad00b])
---------------------------------------
JVMDUMP039I Processing dump event "gpf", detail "" at 2013/11/26 01:05:31 - please wait.
JVMDUMP032I JVM requested System dump using '/usr/share/tomcat6/core.20131126.010531.21202.0001.dmp' in response to an event
JVMDUMP030W Cannot write dump to file /usr/share/tomcat6/core.20131126.010531.21202.0001.dmp: Permission denied
Unhandled exception
Type=Bus error vmState=0x0002001a
J9Generic_Signal_Number=00000008 Signal_Number=00000007 Error_Value=00000000 Signal_Code=00000002
Handler1=00007FB6D2D1EC80 Handler2=00007FB6D29D7FF0 InaccessibleAddress=00007FB6C5700410
RDI=00007FB6CC0B69F8 RSI=00007FB6C5700410 RAX=0000000000002170 RBX=00007FB6C5701990
RCX=00007FB6C5701990 RDX=0000000000000158 R8=00007FB6C5700410 R9=0000000000000158
R10=0000000000000005 R11=0000000000002000 R12=00007FB6C56FDE28 R13=00007FB6CC0B69F8
R14=00007FB6CC0B6AB8 R15=00007FB6CE7DF5D0
RIP=00007FB6D1617806 GS=0000 FS=0000 RSP=00007FB6B4AF16E8
EFlags=0000000000210212 CS=0033 RBP=00007FB6C5700410 ERR=0000000000000006
TRAPNO=000000000000000E OLDMASK=0000000000000000 CR2=00007FB6C5700410
xmm0 000000003f800000 (f: 1065353216.000000, d: 5.263544e-315)
xmm1 0000000040400000 (f: 1077936128.000000, d: 5.325712e-315)
xmm2 000000003f8ccccd (f: 1066192064.000000, d: 5.267689e-315)
xmm3 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm4 4040404040404040 (f: 1077952512.000000, d: 3.250196e+01)
xmm5 5b5b5b5b5b5b5b5b (f: 1532713856.000000, d: 1.213625e+132)
xmm6 2020202020202020 (f: 538976256.000000, d: 6.013470e-154)
xmm7 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm8 00ffff000000ff00 (f: 65280.000000, d: 7.290232e-304)
xmm9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm10 ffffff000000ff00 (f: 65280.000000, d: -nan)
xmm11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
Module=/usr/lib/jvm/java-1.6.0-ibm-1.6.0.14.0.x86_64/jre/lib/amd64/default/libj9gc24.so
Module_base_address=00007FB6D15B2000
Target=2_40_20130704_155156 (Linux 2.6.32-431.el6.x86_64)
CPU=amd64 (4 logical CPUs) (0xeee74000 RAM)
----------- Stack Backtrace -----------
(0x00007FB6D1617806 [libj9gc24.so+0x65806])
(0x00007FB6D1616F0C [libj9gc24.so+0x64f0c])
(0x00007FB6D1615E80 [libj9gc24.so+0x63e80])
(0x00007FB6D1618A27 [libj9gc24.so+0x66a27])
(0x00007FB6D161A621 [libj9gc24.so+0x68621])
(0x00007FB6D1620B12 [libj9gc24.so+0x6eb12])
(0x00007FB6D1620B4A [libj9gc24.so+0x6eb4a])
(0x00007FB6D15D5DCC [libj9gc24.so+0x23dcc])
(0x00007FB6D1C164B4 [libj9jit24.so+0x3b34b4])
---------------------------------------
JVMDUMP039I Processing dump event "gpf", detail "" at 2013/11/26 01:06:14 - please wait.
JVMPORT030W /proc/sys/kernel/core_pattern setting "|/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e" specifies that the core dump is to be piped to an external program.  Attempting to rename either core or core.21532.

JVMDUMP010I System dump written to /tmp/core.20131126.010531.21202.0001.dmp
JVMDUMP030W Cannot write dump to file /usr/share/tomcat6/javacore.20131126.010531.21202.0003.txt: Permission denied
JVMDUMP032I JVM requested Java dump using '/tmp/javacore.20131126.010531.21202.0003.txt' in response to an event
JVMDUMP032I JVM requested System dump using '/usr/share/tomcat6/core.20131126.010614.21202.0002.dmp' in response to an event
JVMDUMP030W Cannot write dump to file /usr/share/tomcat6/core.20131126.010614.21202.0002.dmp: Permission denied
JVMDUMP010I Java dump written to /tmp/javacore.20131126.010531.21202.0003.txt
JVMPORT030W /proc/sys/kernel/core_pattern setting "|/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e" specifies that the core dump is to be piped to an external program.  Attempting to rename either core or core.22217.

JVMDUMP010I System dump written to /tmp/core.20131126.010614.21202.0002.dmp
JVMDUMP030W Cannot write dump to file /usr/share/tomcat6/javacore.20131126.010614.21202.0005.txt: Permission denied
JVMDUMP032I JVM requested Java dump using '/tmp/javacore.20131126.010614.21202.0005.txt' in response to an event
JVMDUMP032I JVM requested Snap dump using '/usr/share/tomcat6/Snap.20131126.010531.21202.0004.trc' in response to an event
JVMDUMP030W Cannot write dump to file /usr/share/tomcat6/Snap.20131126.010531.21202.0004.trc: Permission denied
JVMDUMP010I Snap dump written to /tmp/Snap.20131126.010531.21202.0004.trc
JVMDUMP013I Processed dump event "gpf", detail "".
Nov 26, 2013 1:08:41 AM org.apache.catalina.startup.Catalina stopServer
SEVERE: Catalina.stop: 
Throwable occurred: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:412)
        at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:271)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:258)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:376)
        at java.net.Socket.connect(Socket.java:537)
        at java.net.Socket.connect(Socket.java:486)
        at java.net.Socket.<init>(Socket.java:383)
        at java.net.Socket.<init>(Socket.java:197)
        at org.apache.catalina.startup.Catalina.stopServer(Catalina.java:424)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
        at java.lang.reflect.Method.invoke(Method.java:611)
        at org.apache.catalina.startup.Bootstrap.stopServer(Bootstrap.java:338)
        at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:416)
Nov 26, 2013 1:08:55 AM org.apache.catalina.core.AprLifecycleListener init
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/lib/jvm/java-1.6.0-ibm-1.6.0.14.0.x86_64/jre/lib/amd64/default:/usr/lib/jvm/java-1.6.0-ibm-1.6.0.14.0.x86_64/jre/lib/amd64:/usr/lib/oracle/10.2.0.4/client64/lib:/usr/lib
Nov 26, 2013 1:08:56 AM org.apache.coyote.http11.Http11Protocol init