Bug 1832121

Summary: OpenJDK 11 crashes when calling jstack on the JVM process
Product: Red Hat Enterprise Linux 8 Reporter: Simeon Andreev <simeon.andreev>
Component: java-11-openjdkAssignee: Andrew Dinn <adinn>
Status: CLOSED MIGRATED QA Contact: OpenJDK QA <java-qa>
Severity: medium Docs Contact:
Priority: medium    
Version: 8.5CC: ahughes, aogburn, dbasant, dholmes, loskutov, mmillson, neugens, pandrade, simeon.andreev
Target Milestone: rcKeywords: MigratedToJIRA, Reopened
Target Release: ---Flags: pm-rhel: mirror+
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1897150 (view as bug list) Environment:
Last Closed: 2023-09-12 21:51:27 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1897150    
Attachments:
Description Flags
VM crash log.
none
VM crash log with OpenJDK 11.0.7.
none
pstack, jinfo, jstack attempt (caused crash) and other process infos.
none
Crash log with a fastdebug JDK build. none

Description Simeon Andreev 2020-05-06 06:47:12 UTC 
Created attachment 1685560 [details]
VM crash log.

Description of problem:

OpenJDK 11 crashes on jstack invocation.

Version-Release number of selected component (if applicable):

OpenJDK 11.0.5
OpenJDK 11.0.7

Additional info:

Stack: [0x00007fffb70a4000,0x00007fffb71a4000],  sp=0x00007fffb71a28f8,  free space=1018k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [libpthread.so.0+0xce90]  pthread_getcpuclockid+0x0
V  [libjvm.so+0xe8a751]  Thread::print_on(outputStream*, bool) const+0x51
V  [libjvm.so+0xe8cfc6]  JavaThread::print_on(outputStream*, bool) const+0xe6
V  [libjvm.so+0xe8fd18]  Threads::print_on(outputStream*, bool, bool, bool, bool)+0x668
V  [libjvm.so+0xf04cd0]  VM_Operation::evaluate()+0xe0
V  [libjvm.so+0xf0269f]  VMThread::evaluate_operation(VM_Operation*)+0x11f
V  [libjvm.so+0xf02af5]  VMThread::loop()+0x265
V  [libjvm.so+0xf0302c]  VMThread::run()+0x7c
V  [libjvm.so+0xe90fe5]  Thread::call_run()+0x155
V  [libjvm.so+0xc1a878]  thread_native_entry(Thread*)+0xf8
Comment 2 Simeon Andreev 2020-05-06 06:47:54 UTC 
Created attachment 1685561 [details]
VM crash log with OpenJDK 11.0.7.
Comment 3 Simeon Andreev 2020-05-06 06:59:07 UTC 
Created attachment 1685563 [details]
pstack, jinfo, jstack attempt (caused crash) and other process infos.

The jstack that crashed the JVM was done in response to a hanging test (as part of our automatic regression test infrastructure). Before the jstack we execute a number of other commands to get as much info as possible about the JVM, during the hang.

For some reason, sometimes, our Eclipse-based product is unable to fork processes; we are looking into this. Whenever this occurs, our tests hang at "ava.lang.ProcessImpl.forkAndExec":

Thread[Worker-0: Preparing SmarTest Workspace,5,main], state: RUNNABLE
	java.base.5/java.lang.ProcessImpl.forkAndExec(Native Method)
	java.base.5/java.lang.ProcessImpl.<init>(ProcessImpl.java:340)
	java.base.5/java.lang.ProcessImpl.start(ProcessImpl.java:271)
	java.base.5/java.lang.ProcessBuilder.start(ProcessBuilder.java:1107)
	java.base.5/java.lang.ProcessBuilder.start(ProcessBuilder.java:1071)
	com.verigy.itee.core.util.Util.execAndWaitFor(Util.java:159)
	com.verigy.itee.core.util.LinuxCommands.issueCommand(LinuxCommands.java:245)
	com.verigy.itee.core.util.LinuxCommands.issueCommand(LinuxCommands.java:223)
	com.verigy.itee.core.util.LinuxCommands.issueLSOFCommand(LinuxCommands.java:122)
	com.verigy.itee.core.util.MemoryMonitor.openFileDescriptorsCheck(MemoryMonitor.java:260)
	com.advantest.itee.ate.ui.services.internal.WorkspaceResourcesManager$2.runInWorkspace(WorkspaceResourcesManager.java:334)
	org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:42)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

This is what caused the test hang, as far as we can tell. We don't want jstack to crash for this case though; we are lucky to have printed stack traces from inside the JVM before it was crashed with the jstack invocation (we invoke jstack from a script outside of the JVM process, but under some conditions also dump thread information from within the JVM).

Last known thread stacks:

Thread[Start Level: Equinox Container: b6a244c7-8a79-46f9-8ae4-15f08a516315,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:341)

Thread[Signal Dispatcher,9,system], state: RUNNABLE

Thread[Maintenance SendQueue,5,main], state: WAITING
	java.base.5/jdk.internal.misc.Unsafe.park(Native Method)
	java.base.5/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
	java.base.5/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
	java.base.5/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
	com.advantest.itee.maint.common.agent.SendQueueWorker.run(SendQueueWorker.java:61)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[UDA reference daemon,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
	xoc.ate.cor.uda.java.internal.InternalUda$1.run(InternalUda.java:78)

Thread[Git Repository Closer,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
	org.eclipse.egit.core.RepositoryCache$Closer.run(RepositoryCache.java:463)

Thread[Reference Handler,10,system], state: RUNNABLE
	java.base.5/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
	java.base.5/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
	java.base.5/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)

Thread[MessageDispatcher,6,main], state: RUNNABLE
	java.base.5/java.net.SocketInputStream.socketRead0(Native Method)
	java.base.5/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:168)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:140)
	java.base.5/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
	java.base.5/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
	java.base.5/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
	com.sun.star.lib.connections.socket.SocketConnection.read(SocketConnection.java:138)
	com.sun.star.lib.uno.bridges.java_remote.XConnectionInputStream_Adapter.read(XConnectionInputStream_Adapter.java:48)
	java.base.5/java.io.DataInputStream.readInt(DataInputStream.java:392)
	com.sun.star.lib.uno.protocols.urp.urp.readBlock(urp.java:377)
	com.sun.star.lib.uno.protocols.urp.urp.readMessage(urp.java:103)
	com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.run(java_remote_bridge.java:98)

Thread[Worker-10: Processing  changes since last activation,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.core.internal.jobs.ThreadJob.waitForRun(ThreadJob.java:316)
	org.eclipse.core.internal.jobs.ThreadJob.joinRun(ThreadJob.java:205)
	org.eclipse.core.internal.jobs.ImplicitJobs.begin(ImplicitJobs.java:95)
	org.eclipse.core.internal.jobs.JobManager.beginRule(JobManager.java:298)
	org.eclipse.core.internal.resources.WorkManager.checkIn(WorkManager.java:124)
	org.eclipse.core.internal.resources.Workspace.prepareOperation(Workspace.java:2242)
	org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2287)
	org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2312)
	org.eclipse.dltk.internal.core.ModelManager$2.run(ModelManager.java:1233)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

Thread[Maintenance ReceiveQueue,5,main], state: WAITING
	java.base.5/jdk.internal.misc.Unsafe.park(Native Method)
	java.base.5/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
	java.base.5/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
	java.base.5/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
	com.advantest.itee.maint.common.agent.ReceiveQueueWorker.run(ReceiveQueueWorker.java:48)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[AsynchronousFinalizer,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[Refresh Thread: Equinox Container: b6a244c7-8a79-46f9-8ae4-15f08a516315,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:341)

Thread[ForkJoinPool.commonPool-worker-3,6,main], state: WAITING
	java.base.5/jdk.internal.misc.Unsafe.park(Native Method)
	java.base.5/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
	java.base.5/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
	java.base.5/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)

Thread[AsynchronousFinalizer,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[MessageDispatcher,6,main], state: RUNNABLE
	java.base.5/java.net.SocketInputStream.socketRead0(Native Method)
	java.base.5/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:168)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:140)
	java.base.5/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
	java.base.5/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
	java.base.5/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
	com.sun.star.lib.connections.socket.SocketConnection.read(SocketConnection.java:138)
	com.sun.star.lib.uno.bridges.java_remote.XConnectionInputStream_Adapter.read(XConnectionInputStream_Adapter.java:48)
	java.base.5/java.io.DataInputStream.readInt(DataInputStream.java:392)
	com.sun.star.lib.uno.protocols.urp.urp.readBlock(urp.java:377)
	com.sun.star.lib.uno.protocols.urp.urp.readMessage(urp.java:103)
	com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.run(java_remote_bridge.java:98)

Thread[MessageDispatcher,5,main], state: RUNNABLE
	java.base.5/java.net.SocketInputStream.socketRead0(Native Method)
	java.base.5/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:168)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:140)
	java.base.5/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
	java.base.5/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
	java.base.5/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
	com.sun.star.lib.connections.socket.SocketConnection.read(SocketConnection.java:138)
	com.sun.star.lib.uno.bridges.java_remote.XConnectionInputStream_Adapter.read(XConnectionInputStream_Adapter.java:48)
	java.base.5/java.io.DataInputStream.readInt(DataInputStream.java:392)
	com.sun.star.lib.uno.protocols.urp.urp.readBlock(urp.java:377)
	com.sun.star.lib.uno.protocols.urp.urp.readMessage(urp.java:103)
	com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.run(java_remote_bridge.java:98)

Thread[Common-Cleaner,8,InnocuousThreadGroup], state: TIMED_WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
	java.base.5/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
	java.base.5/java.lang.Thread.run(Thread.java:834)
	java.base.5/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)

Thread[Framework Event Dispatcher: Equinox Container: b6a244c7-8a79-46f9-8ae4-15f08a516315,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:341)

Thread[process reaper,10,system], state: TIMED_WAITING
	java.base.5/jdk.internal.misc.Unsafe.park(Native Method)
	java.base.5/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
	java.base.5/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
	java.base.5/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
	java.base.5/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
	java.base.5/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
	java.base.5/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
	java.base.5/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[com.google.inject.internal.util.$Finalizer,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
	com.google.inject.internal.util.$Finalizer.run(Finalizer.java:114)

Thread[Worker-6: Initialize DLTK,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.core.internal.jobs.ThreadJob.waitForRun(ThreadJob.java:316)
	org.eclipse.core.internal.jobs.ThreadJob.joinRun(ThreadJob.java:205)
	org.eclipse.core.internal.jobs.ImplicitJobs.begin(ImplicitJobs.java:95)
	org.eclipse.core.internal.jobs.JobManager.beginRule(JobManager.java:298)
	org.eclipse.core.internal.resources.WorkManager.checkIn(WorkManager.java:124)
	org.eclipse.core.internal.resources.Workspace.prepareOperation(Workspace.java:2242)
	org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2287)
	org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2312)
	org.eclipse.dltk.core.builder.ScriptBuilderUtil.rebuildAfterUpgrade(ScriptBuilderUtil.java:267)
	org.eclipse.dltk.internal.ui.InitializeJob$WorkerJob.run(InitializeJob.java:35)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

Thread[AsynchronousFinalizer,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[Gogo shell,5,main], state: WAITING
	java.base.5/jdk.internal.misc.Unsafe.park(Native Method)
	java.base.5/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
	java.base.5/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
	java.base.5/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
	java.base.5/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
	java.base.5/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
	java.base.5/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[Java indexing,4,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.jdt.internal.core.search.processing.JobManager.run(JobManager.java:378)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[AsynchronousFinalizer,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[AsynchronousFinalizer,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[MessageDispatcher,5,main], state: RUNNABLE
	java.base.5/java.net.SocketInputStream.socketRead0(Native Method)
	java.base.5/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:168)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:140)
	java.base.5/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
	java.base.5/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
	java.base.5/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
	com.sun.star.lib.connections.socket.SocketConnection.read(SocketConnection.java:138)
	com.sun.star.lib.uno.bridges.java_remote.XConnectionInputStream_Adapter.read(XConnectionInputStream_Adapter.java:48)
	java.base.5/java.io.DataInputStream.readInt(DataInputStream.java:392)
	com.sun.star.lib.uno.protocols.urp.urp.readBlock(urp.java:377)
	com.sun.star.lib.uno.protocols.urp.urp.readMessage(urp.java:103)
	com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.run(java_remote_bridge.java:98)

Thread[DLTK indexing,4,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.dltk.internal.core.search.processing.JobManager.run(JobManager.java:460)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[AsynchronousFinalizer,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[WorkbenchTestable,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:253)
	org.eclipse.ui.internal.UISynchronizer.syncExec(UISynchronizer.java:133)
	org.eclipse.swt.widgets.Display.syncExec(Display.java:5797)
	org.eclipse.e4.ui.internal.workbench.swt.E4Testable.runTest(E4Testable.java:115)
	com.verigy.itee.testframework.runner.AbstructRunner.runTests(AbstructRunner.java:112)
	com.verigy.itee.testframework.runner.AbstructRunner.run(AbstructRunner.java:93)
	com.verigy.itee.testframework.application.TestFrameworkTestApplication.run(TestFrameworkTestApplication.java:392)
	com.verigy.itee.testframework.application.TestFrameworkTestApplication.runTests(TestFrameworkTestApplication.java:154)
	org.eclipse.e4.ui.internal.workbench.swt.E4Testable.lambda$0(E4Testable.java:76)
	org.eclipse.e4.ui.internal.workbench.swt.E4Testable$$Lambda$591/0x0000000840c6a840.run(Unknown Source)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[Worker-1: Checking test program state,5,main], state: TIMED_WAITING
	java.base.5/java.lang.Thread.sleep(Native Method)
	com.verigy.itee.ui.UIPlugin.processUIEvents(UIPlugin.java:729)
	com.verigy.itee.ui.UIPlugin.processUIEvents(UIPlugin.java:714)
	com.advantest.itee.ate.ui.services.internal.InternalTestProgramController$13.run(InternalTestProgramController.java:1649)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

Thread[MessageDispatcher,5,main], state: RUNNABLE
	java.base.5/java.net.SocketInputStream.socketRead0(Native Method)
	java.base.5/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:168)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:140)
	java.base.5/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
	java.base.5/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
	java.base.5/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
	com.sun.star.lib.connections.socket.SocketConnection.read(SocketConnection.java:138)
	com.sun.star.lib.uno.bridges.java_remote.XConnectionInputStream_Adapter.read(XConnectionInputStream_Adapter.java:48)
	java.base.5/java.io.DataInputStream.readInt(DataInputStream.java:392)
	com.sun.star.lib.uno.protocols.urp.urp.readBlock(urp.java:377)
	com.sun.star.lib.uno.protocols.urp.urp.readMessage(urp.java:103)
	com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.run(java_remote_bridge.java:98)

Thread[Thread-36,5,main], state: RUNNABLE

Thread[MessageDispatcher,6,main], state: RUNNABLE
	java.base.5/java.net.SocketInputStream.socketRead0(Native Method)
	java.base.5/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:168)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:140)
	java.base.5/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
	java.base.5/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
	java.base.5/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
	com.sun.star.lib.connections.socket.SocketConnection.read(SocketConnection.java:138)
	com.sun.star.lib.uno.bridges.java_remote.XConnectionInputStream_Adapter.read(XConnectionInputStream_Adapter.java:48)
	java.base.5/java.io.DataInputStream.readInt(DataInputStream.java:392)
	com.sun.star.lib.uno.protocols.urp.urp.readBlock(urp.java:377)
	com.sun.star.lib.uno.protocols.urp.urp.readMessage(urp.java:103)
	com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.run(java_remote_bridge.java:98)

Thread[SCR Component Actor,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.apache.felix.scr.impl.ComponentActorThread.run(ComponentActorThread.java:83)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[AsynchronousFinalizer,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[Worker-13,5,main], state: TIMED_WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:200)
	org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:242)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:58)

Thread[AsynchronousFinalizer,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[MessageDispatcher,6,main], state: RUNNABLE
	java.base.5/java.net.SocketInputStream.socketRead0(Native Method)
	java.base.5/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:168)
	java.base.5/java.net.SocketInputStream.read(SocketInputStream.java:140)
	java.base.5/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
	java.base.5/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
	java.base.5/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
	com.sun.star.lib.connections.socket.SocketConnection.read(SocketConnection.java:138)
	com.sun.star.lib.uno.bridges.java_remote.XConnectionInputStream_Adapter.read(XConnectionInputStream_Adapter.java:48)
	java.base.5/java.io.DataInputStream.readInt(DataInputStream.java:392)
	com.sun.star.lib.uno.protocols.urp.urp.readBlock(urp.java:377)
	com.sun.star.lib.uno.protocols.urp.urp.readMessage(urp.java:103)
	com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.run(java_remote_bridge.java:98)

Thread[Pipe reader for: System Console,5,main], state: RUNNABLE
	java.base.5/java.io.FileInputStream.readBytes(Native Method)
	java.base.5/java.io.FileInputStream.read(FileInputStream.java:279)
	java.base.5/sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
	java.base.5/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
	java.base.5/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
	java.base.5/java.io.InputStreamReader.read(InputStreamReader.java:185)
	java.base.5/java.io.BufferedReader.fill(BufferedReader.java:161)
	java.base.5/java.io.BufferedReader.read1(BufferedReader.java:212)
	java.base.5/java.io.BufferedReader.read(BufferedReader.java:287)
	java.base.5/java.io.Reader.read(Reader.java:229)
	com.verigy.itee.core.util.PipeReaderRunnable.run(PipeReaderRunnable.java:109)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[Worker-JM,5,main], state: TIMED_WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:61)

Thread[FreeMemoryMonitor,6,main], state: TIMED_WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.util.TimerThread.mainLoop(Timer.java:553)
	java.base.5/java.util.TimerThread.run(Timer.java:506)

Thread[EventAdmin Async Event Dispatcher Thread,6,Equinox Event Admin], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:341)

Thread[Active Thread: Equinox Container: b6a244c7-8a79-46f9-8ae4-15f08a516315,5,main], state: TIMED_WAITING
	java.base.5/jdk.internal.misc.Unsafe.park(Native Method)
	java.base.5/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
	java.base.5/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
	java.base.5/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
	java.base.5/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
	java.base.5/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
	java.base.5/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
	java.base.5/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[pool-5-thread-1,5,Equinox Event Admin], state: WAITING
	java.base.5/jdk.internal.misc.Unsafe.park(Native Method)
	java.base.5/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
	java.base.5/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
	java.base.5/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
	java.base.5/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
	java.base.5/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
	java.base.5/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	java.base.5/java.lang.Thread.run(Thread.java:834)

Thread[Worker-21,5,main], state: TIMED_WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:200)
	org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:242)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:58)

Thread[Provisioning Event Dispatcher,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:341)

Thread[EMF Reference Cleaner,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
	org.eclipse.emf.common.util.CommonUtil$1ReferenceClearingQueuePollingThread.run(CommonUtil.java:70)

Thread[Worker-2: Compacting resource model,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.core.internal.jobs.ThreadJob.waitForRun(ThreadJob.java:316)
	org.eclipse.core.internal.jobs.ThreadJob.joinRun(ThreadJob.java:205)
	org.eclipse.core.internal.jobs.ImplicitJobs.begin(ImplicitJobs.java:95)
	org.eclipse.core.internal.jobs.JobManager.beginRule(JobManager.java:298)
	org.eclipse.core.internal.utils.StringPoolJob.run(StringPoolJob.java:101)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

Thread[Worker-19: Initializing Java Tooling,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.core.internal.jobs.ThreadJob.waitForRun(ThreadJob.java:316)
	org.eclipse.core.internal.jobs.ThreadJob.joinRun(ThreadJob.java:205)
	org.eclipse.core.internal.jobs.ImplicitJobs.begin(ImplicitJobs.java:95)
	org.eclipse.core.internal.jobs.JobManager.beginRule(JobManager.java:298)
	org.eclipse.core.internal.resources.WorkManager.checkIn(WorkManager.java:124)
	org.eclipse.core.internal.resources.Workspace.prepareOperation(Workspace.java:2242)
	org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2287)
	org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2312)
	org.eclipse.jdt.core.JavaCore.initializeAfterLoad(JavaCore.java:4653)
	org.eclipse.jdt.internal.ui.InitializeAfterLoadJob$RealJob.run(InitializeAfterLoadJob.java:39)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

Thread[Worker-17: 93000 Problem task queue,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.core.internal.jobs.ThreadJob.waitForRun(ThreadJob.java:316)
	org.eclipse.core.internal.jobs.ThreadJob.joinRun(ThreadJob.java:205)
	org.eclipse.core.internal.jobs.ImplicitJobs.begin(ImplicitJobs.java:95)
	org.eclipse.core.internal.jobs.JobManager.beginRule(JobManager.java:298)
	org.eclipse.core.internal.resources.WorkManager.checkIn(WorkManager.java:124)
	org.eclipse.core.internal.resources.Workspace.prepareOperation(Workspace.java:2242)
	org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2287)
	org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2312)
	com.advantest.itee.ate.problems.internal.ProblemTaskQueueJob.run(ProblemTaskQueueJob.java:179)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

Thread[AsynchronousFinalizer,6,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[Finalizer,8,system], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
	java.base.5/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
	java.base.5/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)

Thread[Bundle File Closer,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
	org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:341)

Thread[AsynchronousFinalizer,5,main], state: WAITING
	java.base.5/java.lang.Object.wait(Native Method)
	java.base.5/java.lang.Object.wait(Object.java:328)
	com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:58)

Thread[Worker-0: Preparing SmarTest Workspace,5,main], state: RUNNABLE
	java.base.5/java.lang.ProcessImpl.forkAndExec(Native Method)
	java.base.5/java.lang.ProcessImpl.<init>(ProcessImpl.java:340)
	java.base.5/java.lang.ProcessImpl.start(ProcessImpl.java:271)
	java.base.5/java.lang.ProcessBuilder.start(ProcessBuilder.java:1107)
	java.base.5/java.lang.ProcessBuilder.start(ProcessBuilder.java:1071)
	com.verigy.itee.core.util.Util.execAndWaitFor(Util.java:159)
	com.verigy.itee.core.util.LinuxCommands.issueCommand(LinuxCommands.java:245)
	com.verigy.itee.core.util.LinuxCommands.issueCommand(LinuxCommands.java:223)
	com.verigy.itee.core.util.LinuxCommands.issueLSOFCommand(LinuxCommands.java:122)
	com.verigy.itee.core.util.MemoryMonitor.openFileDescriptorsCheck(MemoryMonitor.java:260)
	com.advantest.itee.ate.ui.services.internal.WorkspaceResourcesManager$2.runInWorkspace(WorkspaceResourcesManager.java:334)
	org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:42)
	org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

Thread[main,6,main], state: RUNNABLE
	java.base.5/java.lang.Thread.dumpThreads(Native Method)
	java.base.5/java.lang.Thread.getAllStackTraces(Thread.java:1657)
	com.verigy.itee.core.util.Util.getThreadsDump(Util.java:429)
	com.verigy.itee.core.test.JunitHelper.reportRunningJobsExcept(JunitHelper.java:898)
	com.verigy.itee.core.test.JunitHelper.cancelAllJobsExcept(JunitHelper.java:919)
	com.verigy.itee.core.test.JunitHelper.waitForJobs(JunitHelper.java:795)
	com.verigy.itee.core.test.JunitHelper.waitForJobs(JunitHelper.java:819)
	com.verigy.itee.core.test.JunitHelper.setup(JunitHelper.java:1029)
	com.verigy.itee.core.test.Junit4TestCase.setUp(Junit4TestCase.java:86)
	java.base.5/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	java.base.5/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	java.base.5/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.base.5/java.lang.reflect.Method.invoke(Method.java:566)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	com.verigy.itee.core.test.internal.RunBefores93k.evaluate(RunBefores93k.java:39)
	com.verigy.itee.core.test.internal.BlockJUnit4ClassRunner93k$1.evaluate(BlockJUnit4ClassRunner93k.java:193)
	com.verigy.itee.core.test.internal.RunAfters93k.evaluate(RunAfters93k.java:43)
	org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
	org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	com.verigy.itee.core.test.internal.BlockJUnit4ClassRunner93k.runLeafCopy(BlockJUnit4ClassRunner93k.java:124)
	com.verigy.itee.core.test.internal.BlockJUnit4ClassRunner93k.runChild(BlockJUnit4ClassRunner93k.java:111)
	org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	com.verigy.itee.core.test.internal.BlockJUnit4ClassRunner93k.run(BlockJUnit4ClassRunner93k.java:91)
	org.junit.runners.Suite.runChild(Suite.java:128)
	org.junit.runners.Suite.runChild(Suite.java:27)
	org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	com.verigy.itee.testframework.runner.JUnit4and3TestAdapter.run(JUnit4and3TestAdapter.java:61)
	com.verigy.itee.testframework.runner.JunitTestRunner$JunitRunnable.run(JunitTestRunner.java:58)
	org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:40)
	org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:185)
	org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4930)
	org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:4451)
	org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$5.run(PartRenderingEngine.java:1160)
	org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:338)
	org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1049)
	org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:155)
	org.eclipse.ui.internal.Workbench.lambda$3(Workbench.java:658)
	org.eclipse.ui.internal.Workbench$$Lambda$165/0x00000008403b5840.run(Unknown Source)
	org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:338)
	org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:557)
	org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:154)
	com.verigy.itee.ui.SmarTestIdeApplication.start(SmarTestIdeApplication.java:125)
	com.verigy.itee.testframework.application.TestFrameworkTestApplication.start(TestFrameworkTestApplication.java:416)
	org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:203)
	org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:137)
	org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:107)
	org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:401)
	org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:255)
	java.base.5/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	java.base.5/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	java.base.5/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.base.5/java.lang.reflect.Method.invoke(Method.java:566)
	app//org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:657)
	app//org.eclipse.equinox.launcher.Main.basicRun(Main.java:594)
	app//org.eclipse.equinox.launcher.Main.run(Main.java:1447)
	app//org.eclipse.equinox.launcher.Main.main(Main.java:1420)
Comment 4 Simeon Andreev 2020-05-12 07:05:57 UTC 
Created attachment 1687548 [details]
Crash log with a fastdebug JDK build.

While running our tests with a fastdebug build (as requested in bug 1828845), we observed this crash again.

There is some assertion that fails, see attached crash log:

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  Internal Error (/data/rpmbuild/BUILD/java-11-openjdk-11.0.7.10-4.el7.x86_64/openjdk/src/hotspot/os/linux/os_linux.cpp:4850), pid=77714, tid=77725
#  assert(rc == 0) failed: clock_gettime is expected to return 0 code
#
# JRE version: OpenJDK Runtime Environment (11.0.7+10) (fastdebug build 11.0.7+10-LTS)
# Java VM: OpenJDK 64-Bit Server VM (fastdebug 11.0.7+10-LTS, mixed mode, sharing, tiered, compressed oops, parallel gc, linux-amd64)
# No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
#

---------------  S U M M A R Y ------------

Command Line: -Dosgi.dataAreaRequiresExplicitInit=true -Xmx2048m --add-modules=ALL-SYSTEM -D93k.eclipseid=/93k_workspace -DXOC_SYSTEM=/workspaces/socbm275/sandreev/ws-java11/vobs/zenith/workspace/system -D93k.isOnline=false -Xmx24G -Xms1G -Xss5m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -DmaxCompiledUnitsAtOnce=0 -Dxtext.qn.interning=true -Dxtext.skipSecondaryTypes=true -Dosgi.bundlefile.limit=100 -Declipse.log.size.max=20000 -Declipse.log.backup.max=50 -Dorg.eclipse.core.resources.disable_advanced_recursive_link_checks -Dorg.eclipse.wst.validation.ui.disable.validation.context.menu=true -Dfile.encoding=UTF8 -Dorg.eclipse.tips.startup.default=dialog -Dlog4jloc=/workspaces/socbm275/sandreev/ws-java11/opt/93000/src/segments/eclipse/test_framework/test_results/INTEGRATION/logs/log4j/log4jlog.txt -javaagent:/opt/hp93000rt/el7/x86_64/jacoco-0.7.x/0.8.5/lib/jacocoagent.jar=destfile=/workspaces/socbm275/sandreev/ws-java11/opt/93000/src/segments/eclipse/test_framework/test_results/INTEGRATION/reports/coverage/jacoco.exec -XX:ErrorFile=/tmp/sandreev_ws-java11//eclipse_vm_crash_%p.log /workspaces/socbm275/sandreev/ws-java11/opt/hp93000/soc/segments/eclipse/eclipseForTest//plugins/org.eclipse.equinox.launcher_1.5.700.v20200207-2156.jar -os linux -ws gtk -arch x86_64 -launcher /workspaces/socbm275/sandreev/ws-java11/opt/hp93000/soc/segments/eclipse/eclipseForTest/eclipse -name Eclipse --launcher.library /workspaces/socbm275/sandreev/ws-java11/opt/hp93000/soc/segments/eclipse/eclipseForTest//plugins/org.eclipse.equinox.launcher.gtk.linux.x86_64_1.1.1100.v20190907-0426/eclipse_1801.so -startup /workspaces/socbm275/sandreev/ws-java11/opt/hp93000/soc/segments/eclipse/eclipseForTest//plugins/org.eclipse.equinox.launcher_1.5.700.v20200207-2156.jar --launcher.appendVmargs -exitdata 7a05808c -showLocation -product com.verigy.itee.ui.ewcProduct -application com.verigy.itee.testframework.ewc_test_framework -configuration /opt/hp93000/soc64_IworkspacesIsocbm275IsandreevIws-java11/segments/eclipse/eclipseForTest/configuration -data /tmp/sandreev_ws-java11/ -clean -vm /usr/lib/jvm/java-11-openjdk-11.0.7.10-4.el7.x86_64-debug/bin/java -vmargs -Dosgi.dataAreaRequiresExplicitInit=true -Xmx2048m --add-modules=ALL-SYSTEM -D93k.eclipseid=/93k_workspace -DXOC_SYSTEM=/workspaces/socbm275/sandreev/ws-java11/vobs/zenith/workspace/system -D93k.isOnline=false -Xmx24G -Xms1G -Xss5m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -DmaxCompiledUnitsAtOnce=0 -Dxtext.qn.interning=true -Dxtext.skipSecondaryTypes=true -Dosgi.bundlefile.limit=100 -Declipse.log.size.max=20000 -Declipse.log.backup.max=50 -Dorg.eclipse.core.resources.disable_advanced_recursive_link_checks -Dorg.eclipse.wst.validation.ui.disable.validation.context.menu=true -Dfile.encoding=UTF8 -Dorg.eclipse.tips.startup.default=dialog -Dlog4jloc=/workspaces/socbm275/sandreev/ws-java11/opt/93000/src/segments/eclipse/test_framework/test_results/INTEGRATION/logs/log4j/log4jlog.txt -javaagent:/opt/hp93000rt/el7/x86_64/jacoco-0.7.x/0.8.5/lib/jacocoagent.jar=destfile=/workspaces/socbm275/sandreev/ws-java11/opt/93000/src/segments/eclipse/test_framework/test_results/INTEGRATION/reports/coverage/jacoco.exec -XX:ErrorFile=/tmp/sandreev_ws-java11//eclipse_vm_crash_%p.log -jar /workspaces/socbm275/sandreev/ws-java11/opt/hp93000/soc/segments/eclipse/eclipseForTest//plugins/org.eclipse.equinox.launcher_1.5.700.v20200207-2156.jar

Host: socbm275, Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 12 cores, 62G, Red Hat Enterprise Linux Workstation release 7.4 (Maipo)
Time: Tue May 12 00:09:24 2020 CEST elapsed time: 4199 seconds (0d 1h 9m 59s)

---------------  T H R E A D  ---------------

Current thread (0x00007ffff02bd000):  VMThread "VM Thread" [stack: 0x00007fff9bb9d000,0x00007fff9bc9d000] [id=77725]

Stack: [0x00007fff9bb9d000,0x00007fff9bc9d000],  sp=0x00007fff9bc9b3b0,  free space=1016k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
V  [libjvm.so+0x1a2d830]  VMError::report_and_die(int, char const*, char const*, __va_list_tag*, Thread*, unsigned char*, void*, void*, char const*, int, unsigned long)+0x230
V  [libjvm.so+0x1a2e907]  VMError::report_and_die(Thread*, void*, char const*, int, char const*, char const*, __va_list_tag*)+0x47
V  [libjvm.so+0xb72cd1]  report_vm_error(char const*, int, char const*, char const*, ...)+0x131
V  [libjvm.so+0x153c6ef]  os::thread_cpu_time(Thread*, bool)+0x11f
V  [libjvm.so+0x195d155]  Thread::print_on(outputStream*, bool) const+0x55
V  [libjvm.so+0x19629b9]  JavaThread::print_on(outputStream*, bool) const+0x149
V  [libjvm.so+0x1966ee7]  Threads::print_on(outputStream*, bool, bool, bool, bool)+0x247
V  [libjvm.so+0x1a31d5d]  VM_Operation::evaluate()+0x13d
V  [libjvm.so+0x1a6fdae]  VMThread::evaluate_operation(VM_Operation*)+0x1ae
V  [libjvm.so+0x1a7069c]  VMThread::loop()+0x2dc
V  [libjvm.so+0x1a70d94]  VMThread::run()+0xd4
V  [libjvm.so+0x1969a3a]  Thread::call_run()+0x7a
V  [libjvm.so+0x153f5e0]  thread_native_entry(Thread*)+0x110
Comment 5 Simeon Andreev 2020-05-12 07:48:04 UTC 
This more or less prevents us from updating to Java 11, since we can't analyse test hangs.

We don't see the problem with Java 8, although the related code seems to not have changed from JDK 8 to JDK 11:

http://hg.openjdk.java.net/jdk8/jdk8/hotspot/file/87ee5ee27509/src/os/linux/vm/os_linux.cpp#l4507
http://hg.openjdk.java.net/jdk/jdk11/file/1ddf9a99e4ad/src/hotspot/os/linux/os_linux.cpp#l4727

Any ideas what might cause this? Maybe something did change with JDK 9+?

It would also be great if the assertion error message includes the actual return code and not just state "it wasn't 0".
Comment 6 Simeon Andreev 2020-05-13 13:40:40 UTC 
We noticed this OpenJDK bug: https://bugs.openjdk.java.net/browse/JDK-8205878

Is it possible that the thread is terminating while the code in b/src/hotspot/os/linux/os_linux.cpp is running?

I.e. os::Linux::fast_thread_cpu_time(clockid) is called with a terminate thread that had an id at the beginning of fast_cpu_time(Thread*)?
Comment 7 Simeon Andreev 2020-05-13 13:46:19 UTC 
Also note sure I understand this comment: https://bugs.openjdk.java.net/browse/JDK-8206954?focusedCommentId=14194417&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14194417

It means, a JNI terminated thread that was attached at some point, but was never detached, can crash the JVM on jstack?
Comment 8 Paulo Andrade 2020-07-07 18:28:17 UTC 
  A naive pseudo patch should be something like this:

openjdk/src/hotspot/os/linux/os_linux.cpp:os::Linux::fast_thread_cpu_time()
...
   int rc = os::Linux::clock_gettime(clockid, &tp);
-  assert(rc == 0, "clock_gettime is expected to return 0 code");
+  if (rc != 0) return slow_thread_cpu_time(true);
...

but the above would likely only hide a problem, and/or crash elsewhere.

  It should also be worth to note that usually a "production" openjdk
build should be built with -DNDEBUG. Looking at the build logs for
java-1.8.0-openjdk and java-11-openjdk I see a quite different usage for
NDEBUG. It might happen that for java-11-openjdk os_linux.cpp is not
being built with NDEBUG.

  For java-18.0-openjdk, with NDEBUG not defined, then the assert becomes
a noop and it will just return some bogus value.
Comment 9 Andrey Loskutov 2020-07-10 14:31:56 UTC 
(In reply to Paulo Andrade from comment #8)
>   A naive pseudo patch should be something like this:
> 
> openjdk/src/hotspot/os/linux/os_linux.cpp:os::Linux::fast_thread_cpu_time()
> ...
>    int rc = os::Linux::clock_gettime(clockid, &tp);
> -  assert(rc == 0, "clock_gettime is expected to return 0 code");
> +  if (rc != 0) return slow_thread_cpu_time(true);
> ...
> 
> but the above would likely only hide a problem, and/or crash elsewhere.

But this seem only affect the case with crash due assert, like in comment 4.
Original stack doesn't have assert error, it is SIGSEGV.
We just got this again reported:

# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007ffff79b5e90, pid=70255, tid=70262
#
# JRE version: OpenJDK Runtime Environment (11.0.7+10) (build 11.0.7+10-LTS)
# Java VM: OpenJDK 64-Bit Server VM (11.0.7+10-LTS, mixed mode, tiered, g1 gc, linux-amd64)
# Problematic frame:
# C  [libpthread.so.0+0xce90]  pthread_getcpuclockid+0x0

[...]

Current thread (0x00007ffff029d000):  VMThread "VM Thread" [stack: 0x00007ff3609a0000,0x00007ff360aa0000] [id=70262]

Stack: [0x00007ff3609a0000,0x00007ff360aa0000],  sp=0x00007ff360a9e7d8,  free space=1017k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [libpthread.so.0+0xce90]  pthread_getcpuclockid+0x0
V  [libjvm.so+0xea5231]  Thread::print_on(outputStream*, bool) const+0x51
V  [libjvm.so+0xea80b6]  JavaThread::print_on(outputStream*, bool) const+0xe6
V  [libjvm.so+0xeab0e8]  Threads::print_on(outputStream*, bool, bool, bool, bool)+0x668
V  [libjvm.so+0xf1ab80]  VM_Operation::evaluate()+0xe0
V  [libjvm.so+0xf2095f]  VMThread::evaluate_operation(VM_Operation*)+0x11f
V  [libjvm.so+0xf20dde]  VMThread::loop()+0x28e
V  [libjvm.so+0xf2134c]  VMThread::run()+0x7c
V  [libjvm.so+0xeac30a]  Thread::call_run()+0x16a
V  [libjvm.so+0xc216a8]  thread_native_entry(Thread*)+0xf8

siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr: 0x00007ff2b7bfb9d0

Question 1:

If we patch JDK locally to avoid calling pthread_getcpuclockid and instead always use slow_thread_cpu_time, would it avoid the crash?

Question 2:

We see this as a clear regression while switching from Java 8 to Java 11.
Any idea *which* change in JDK caused this? Could it be related to this commit: http://hg.openjdk.java.net/jdk/jdk11/rev/1835f9fca157

Question 3: 

any other ideas how to get JVM thread dump from outside the JVM *without* jstack?
Comment 10 Andrew John Hughes 2020-07-29 17:10:24 UTC 
Do you see this issue with product builds or just when using a fastdebug build?

A fastdebug build is primarily intended for debugging the JVM. If you're not trying to debug a JDK issue, I would suggest sticking to the product build.

The version of OpenJDK 11 you're using contains the fix for JDK-8205878.

One suggestion would be to add a strerror call to the assert, so we can see what error is causing the non-zero return value:

diff --git a/src/hotspot/os/linux/os_linux.cpp b/src/hotspot/os/linux/os_linux.cpp
--- a/src/hotspot/os/linux/os_linux.cpp
+++ b/src/hotspot/os/linux/os_linux.cpp
@@ -4865,7 +4865,7 @@
 jlong os::Linux::fast_thread_cpu_time(clockid_t clockid) {
   struct timespec tp;
   int rc = os::Linux::clock_gettime(clockid, &tp);
-  assert(rc == 0, "clock_gettime is expected to return 0 code");
+  assert(rc == 0, "clock_gettime is expected to return 0 code: %s", os::strerror(errno));
 
   return (tp.tv_sec * NANOSECS_PER_SEC) + tp.tv_nsec;
 }
Comment 11 Andrey Loskutov 2020-07-29 17:30:21 UTC 
We see this on production builds.
Comment 12 Simeon Andreev 2020-07-29 19:48:35 UTC 
Can we also print the thread name in the patch? If that would also crash the JDK (because a thread is leaving and it has invalid pointer or whatever), maybe there is a location at which only some crashes will result in accessing the thread name, and other crashes will be the one reported here. If the problem is an invalid pointer, it would be good to know which thread is the "short-lived" one.

I intended to add the thread name to the assertion and try to reproduce the issue but didn't get to this.
Comment 13 Simeon Andreev 2020-08-04 08:11:24 UTC 
I've attached a core dump with a debug build: https://access.redhat.com/support/cases/#/case/02694877?attachmentId=a092K000025JDNEQA4

Unfortunately I don't see more output:

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  Internal Error (/data/rpmbuild/BUILD/java-11-openjdk-11.0.8.10-0.el7.x86_64/openjdk/src/hotspot/os/linux/os_linux.cpp:4870), pid=7873, tid=7890
#  assert(rc == 0) failed: clock_gettime is expected to return 0 code
#
# JRE version: OpenJDK Runtime Environment 18.9 (11.0.8+10) (slowdebug build 11.0.8+10-LTS)
# Java VM: OpenJDK 64-Bit Server VM 18.9 (slowdebug 11.0.8+10-LTS, mixed mode, sharing, tiered, compressed oops, g1 gc, linux-amd64)
# Core dump will be written. Default location: Core dumps may be processed with "/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e %P %I %h" (or dumping to /tmp/sandreev_ws-dev-andreev_devices/74act299/core.7873)
#
# If you would like to submit a bug report, please visit:
#   https://bugreport.java.com/bugreport/crash.jsp
#

I think I forgot to change the spec file and so forgot to add the patches to the applied patches section. I'll try again...
Comment 14 Paulo Andrade 2020-08-04 17:49:08 UTC 
If I understood correctly, you did build from sources, is that right?

The coredump is from java-11-openjdk-11.0.8.10-0.el7. The closest ones
from Red Hat are java-11-openjdk-11.0.8.10-0.el7_8 and
java-11-openjdk-11.0.8.10-1.el7.

Can you please upload the resulting rpms? Otherwise we cannot help checking
the coredump in gdb.
Comment 15 Simeon Andreev 2020-08-07 13:43:15 UTC 
I attached a core dump with a build that has the patch from comment 11:

https://access.redhat.com/support/cases/#/case/02694877?attachmentId=a092K000025JQd3QAG

Unfortunately the crash seems to be elsewhere, where no assertion is present:

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007ffff79b5e90, pid=17235, tid=17242
#
# JRE version: OpenJDK Runtime Environment 18.9 (11.0.8+10) (slowdebug build 11.0.8+10-LTS)
# Java VM: OpenJDK 64-Bit Server VM 18.9 (slowdebug 11.0.8+10-LTS, mixed mode, sharing, tiered, compressed oops, g1 gc, linux-amd64)
# Problematic frame:
# C  [libpthread.so.0+0xce90]  pthread_getcpuclockid+0x0
#
# Core dump will be written. Default location: Core dumps may be processed with "/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e %P %I %h" (or dumping to /tmp/sandreev_ws-dev-andreev_devices/74act299/core.17235)
#
# If you would like to submit a bug report, please visit:
#   https://bugreport.java.com/bugreport/crash.jsp
#
Comment 16 Simeon Andreev 2020-08-07 13:43:50 UTC 
The patch from comment 10 *, sorry.
Comment 19 Simeon Andreev 2020-08-13 12:48:11 UTC 
Can we get a patch that includes the thread name into the assertion fail, if the thread name is available?
Comment 21 Paulo Andrade 2020-08-24 13:58:37 UTC 
The _osthread._thread_type of -235802127 (0xf1f1f1f1) might provide some
hint based on the pattern? It should have been one of:

  enum ThreadType {
    vm_thread,
    cgc_thread,        // Concurrent GC thread
    pgc_thread,        // Parallel GC thread
    java_thread,       // Java, CodeCacheSweeper, JVMTIAgent and Service threads.
    compiler_thread,
    watcher_thread,
    os_thread
  };

The Java thread unhandled_oops 0xf1f1f1f1f1f1f1f1 value might also point to some
issue.

Closest wild match I could find is an old bug report at
https://bugs.java.com/bugdatabase/view_bug.do?bug_id=JDK-8049304
[JDK-8049304 : race between VM_Exit and _sync_FutileWakeups->inc()]

Maybe it could also be some dynamically loaded jni code that did create a thread
and dit not properly exit before being unloaded.
Comment 22 Simeon Andreev 2020-08-24 14:05:37 UTC 
(In reply to Paulo Andrade from comment #21)
> [..]
> Maybe it could also be some dynamically loaded jni code that did create a
> thread and dit not properly exit before being unloaded.

What sort of pattern should I look for in JNI code? Code calls method "xyz" but forgets to call "abc" (if so, what methods)?

There is a ton of native code running with Eclipse (e.g. GTK+) but not so much JNI code (should be mainly SWT and the launcher).
Comment 24 Simeon Andreev 2020-08-31 06:12:29 UTC 
I've listed reproduction steps in the RHEL support case: https://access.redhat.com/support/cases/#/case/02694877?commentId=a0a2K00000WQM8bQAH
Comment 26 Simeon Andreev 2020-09-16 10:19:46 UTC 
I've reproduced this with the steps from comment 24 on a CentOS 8 VM (Oracle VM VirtualBox 6.1.8, running under Windows 10 on fully unrelated hardware). We chose CentOS 8 as the closest OS to RHEL 8, that is readily available for a VM.

The VM is a fresh install from this ISO: http://mirrors.daticum.com/centos/8.2.2004/isos/x86_64/CentOS-8.2.2004-x86_64-dvd1.iso

The only RPMs on top of the fresh (default) install are OpenJDK 11 and its dependencies:

[root@localhost cr140121]# yum install java-11-openjdk-jmods java-11-openjdk-src  java-11-openjdk-javadoc-zip
Last metadata expiration check: 0:33:18 ago on Wed 16 Sep 2020 05:18:08 AM EDT.
Dependencies resolved.
================================================================================
 Package                       Arch     Version               Repository   Size
================================================================================
Installing:
 java-11-openjdk-javadoc-zip   x86_64   1:11.0.8.10-0.el8_2   AppStream    42 M
 java-11-openjdk-jmods         x86_64   1:11.0.8.10-0.el8_2   AppStream   322 M
 java-11-openjdk-src           x86_64   1:11.0.8.10-0.el8_2   AppStream    50 M

Transaction Summary
================================================================================
Install  3 Packages

Total download size: 415 M
Installed size: 433 M
Is this ok [y/N]: y
Downloading Packages:
                         [===                 ] ---  B/s |   0  B     --:-- ETA
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'yum clean packages'.
Error: Error downloading packages:
  Curl error (6): Couldn't resolve host name for http://mirrorlist.centos.org/?release=8&arch=x86_64&repo=AppStream&infra=stock [Could not resolve host: mirrorlist.centos.org]
[root@localhost cr140121]# yum install java-11-openjdk-jmods java-11-openjdk-src  java-11-openjdk-javadoc-zip
Last metadata expiration check: 0:33:31 ago on Wed 16 Sep 2020 05:18:08 AM EDT.
Dependencies resolved.
================================================================================
 Package                       Arch     Version               Repository   Size
================================================================================
Installing:
 java-11-openjdk-javadoc-zip   x86_64   1:11.0.8.10-0.el8_2   AppStream    42 M
 java-11-openjdk-jmods         x86_64   1:11.0.8.10-0.el8_2   AppStream   322 M
 java-11-openjdk-src           x86_64   1:11.0.8.10-0.el8_2   AppStream    50 M

Transaction Summary
================================================================================
Install  3 Packages

Total download size: 415 M
Installed size: 433 M
Is this ok [y/N]: y
Downloading Packages:
(1/3): java-11-openjdk-javadoc-zip-11.0.8.10-0. 4.2 MB/s |  42 MB     00:09    
(2/3): java-11-openjdk-src-11.0.8.10-0.el8_2.x8 3.4 MB/s |  50 MB     00:14    
(3/3): java-11-openjdk-jmods-11.0.8.10-0.el8_2. 8.4 MB/s | 322 MB     00:38    
--------------------------------------------------------------------------------
Total                                            11 MB/s | 415 MB     00:39     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64         1/3 
  Installing       : java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64       2/3 
  Installing       : java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_   3/3 
  Running scriptlet: java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_   3/3 
/sbin/ldconfig: File /lib64/libsctp.so.1 is empty, not checked.
/sbin/ldconfig: File /lib64/libsctp.so.1.0.18 is empty, not checked.

  Verifying        : java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_   1/3 
  Verifying        : java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64       2/3 
  Verifying        : java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64         3/3 
Installed products updated.

Installed:
  java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_64                        
  java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64                              
  java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64                                

Complete!
[root@localhost cr140121]# exit
exit
[sandreev@localhost cr140121]$ java -verbose -version
[sandreev@localhost cr140121]$ java -version
[sandreev@localhost cr140121]$ su
Password: 
[root@localhost cr140121]# yum history
yID     | Command line             | Date and time    | Action(s)      | Altered
-------------------------------------------------------------------------------
     3 | install java-11-openjdk- | 2020-09-16 05:50 | Install        |    3 EE
     2 | install java-11-openjdk- | 2020-09-16 05:18 | Install        |    9   
     1 |                          | 2020-09-16 04:11 | Install        | 1348 EE
u[root@localhost cr140121]# yum history undo 2 3
Found more than one transaction ID.
'undo' requires one transaction ID or package name.
Error: Found more than one transaction ID.
'undo' requires one transaction ID or package name.
[root@localhost cr140121]# yum history undo 2
Last metadata expiration check: 0:33:13 ago on Wed 16 Sep 2020 05:18:08 AM EDT.
Undoing transaction 2, from Wed 16 Sep 2020 05:18:28 AM EDT
    Install copy-jdk-configs-3.7-1.el8.noarch                                 @AppStream
    Install java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64                        @AppStream
    Install java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64                  @AppStream
    Install java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64               @AppStream
    Install javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b8c10bd.noarch @AppStream
    Install ttmkfdir-3.0.9-54.el8.x86_64                                      @AppStream
    Install tzdata-java-2020a-1.el8.noarch                                    @AppStream
    Install xorg-x11-fonts-Type1-7.5-19.el8.noarch                            @AppStream
    Install lksctp-tools-1.0.18-3.el8.x86_64                                  @BaseOS
Error: 
 Problem 1: problem with installed package java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64
  - package java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64 requires java-11-openjdk-devel = 1:11.0.8.10-0.el8_2, but none of the providers can be installed
  - conflicting requests
 Problem 2: problem with installed package java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64
  - package java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64 requires java-11-openjdk-headless(x86-64) = 1:11.0.8.10-0.el8_2, but none of the providers can be installed
  - conflicting requests
 Problem 3: problem with installed package java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_64
  - package java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_64 requires javapackages-filesystem, but none of the providers can be installed
  - conflicting requests
(try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
[root@localhost cr140121]# yum history undo 3
Last metadata expiration check: 0:33:16 ago on Wed 16 Sep 2020 05:18:08 AM EDT.
Undoing transaction 3, from Wed 16 Sep 2020 05:50:35 AM EDT
    Install java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_64 @AppStream
    Install java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64       @AppStream
    Install java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64         @AppStream
Dependencies resolved.
================================================================================
 Package                      Arch    Version                 Repository   Size
================================================================================
Removing:
 java-11-openjdk-javadoc-zip  x86_64  1:11.0.8.10-0.el8_2     @AppStream   47 M
 java-11-openjdk-jmods        x86_64  1:11.0.8.10-0.el8_2     @AppStream  331 M
 java-11-openjdk-src          x86_64  1:11.0.8.10-0.el8_2     @AppStream   56 M

Transaction Summary
================================================================================
Remove  3 Packages

Freed space: 433 M
Is this ok [y/N]: y
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Erasing          : java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64         1/3 
  Erasing          : java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64       2/3 
  Erasing          : java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_   3/3 
  Running scriptlet: java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_   3/3 
/sbin/ldconfig: File /lib64/libsctp.so.1 is empty, not checked.
/sbin/ldconfig: File /lib64/libsctp.so.1.0.18 is empty, not checked.

  Verifying        : java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_   1/3 
  Verifying        : java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64       2/3 
  Verifying        : java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64         3/3 
Installed products updated.

Removed:
  java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_64                        
  java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64                              
  java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64                                

Complete!
[root@localhost cr140121]# yum history undo 2
Last metadata expiration check: 0:33:21 ago on Wed 16 Sep 2020 05:18:08 AM EDT.
Undoing transaction 2, from Wed 16 Sep 2020 05:18:28 AM EDT
    Install copy-jdk-configs-3.7-1.el8.noarch                                 @AppStream
    Install java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64                        @AppStream
    Install java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64                  @AppStream
    Install java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64               @AppStream
    Install javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b8c10bd.noarch @AppStream
    Install ttmkfdir-3.0.9-54.el8.x86_64                                      @AppStream
    Install tzdata-java-2020a-1.el8.noarch                                    @AppStream
    Install xorg-x11-fonts-Type1-7.5-19.el8.noarch                            @AppStream
    Install lksctp-tools-1.0.18-3.el8.x86_64                                  @BaseOS
Dependencies resolved.
================================================================================
 Package                  Arch   Version                       Repository  Size
================================================================================
Removing:
 copy-jdk-configs         noarch 3.7-1.el8                     @AppStream  16 k
 java-11-openjdk          x86_64 1:11.0.8.10-0.el8_2           @AppStream 741 k
 java-11-openjdk-devel    x86_64 1:11.0.8.10-0.el8_2           @AppStream 5.2 M
 java-11-openjdk-headless x86_64 1:11.0.8.10-0.el8_2           @AppStream 171 M
 javapackages-filesystem  noarch 5.3.0-1.module_el8.0.0+11+5b8c10bd
                                                               @AppStream 1.9 k
 lksctp-tools             x86_64 1.0.18-3.el8                  @BaseOS    252 k
 ttmkfdir                 x86_64 3.0.9-54.el8                  @AppStream 140 k
 tzdata-java              noarch 2020a-1.el8                   @AppStream 365 k
 xorg-x11-fonts-Type1     noarch 7.5-19.el8                    @AppStream 863 k

Transaction Summary
================================================================================
Remove  9 Packages

Freed space: 179 M
Is this ok [y/N]: y
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Erasing          : java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64       1/9 
  Running scriptlet: java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64       1/9 
/var/lib/alternatives/javac empty!
/var/lib/alternatives/java_sdk_openjdk empty!
/var/lib/alternatives/java_sdk_11 empty!
/var/lib/alternatives/java_sdk_11_openjdk empty!

  Erasing          : java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64             2/9 
  Running scriptlet: java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64             2/9 
  Erasing          : xorg-x11-fonts-Type1-7.5-19.el8.noarch                 3/9 
  Running scriptlet: xorg-x11-fonts-Type1-7.5-19.el8.noarch                 3/9 
  Erasing          : java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64    4/9 
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/lib/security/public_suffix_list.dat saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/lib/security/public_suffix_list.dat.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/lib/security/default.policy saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/lib/security/default.policy.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/lib/security/blacklisted.certs saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/lib/security/blacklisted.certs.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/sound.properties saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/sound.properties.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/unlimited/default_local.policy saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/unlimited/default_local.policy.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/unlimited/default_US_export.policy saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/unlimited/default_US_export.policy.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/limited/exempt_local.policy saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/limited/exempt_local.policy.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/limited/default_local.policy saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/limited/default_local.policy.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/limited/default_US_export.policy saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/policy/limited/default_US_export.policy.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/nss.fips.cfg saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/nss.fips.cfg.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/nss.cfg saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/nss.cfg.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/java.security saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/java.security.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/java.policy saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/security/java.policy.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/net.properties saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/net.properties.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/management/management.properties saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/management/management.properties.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/management/jmxremote.password.template saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/management/jmxremote.password.template.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/management/jmxremote.access saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/management/jmxremote.access.rpmsave
warning: /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/logging.properties saved as /etc/java/java-11-openjdk/java-11-openjdk-11.0.8.10-0.el8_2.x86_64/conf/logging.properties.rpmsave

  Running scriptlet: java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64    4/9 
/var/lib/alternatives/java empty!
/var/lib/alternatives/jre_openjdk empty!
/var/lib/alternatives/jre_11 empty!
/var/lib/alternatives/jre_11_openjdk empty!
warning: %postun(java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64) scriptlet failed, exit status 2

Error in POSTUN scriptlet in rpm package java-11-openjdk-headless
  Erasing          : copy-jdk-configs-3.7-1.el8.noarch                      5/9 
  Erasing          : javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b   6/9 
  Erasing          : tzdata-java-2020a-1.el8.noarch                         7/9 
  Erasing          : lksctp-tools-1.0.18-3.el8.x86_64                       8/9 
  Running scriptlet: lksctp-tools-1.0.18-3.el8.x86_64                       8/9 
  Erasing          : ttmkfdir-3.0.9-54.el8.x86_64                           9/9 
  Running scriptlet: ttmkfdir-3.0.9-54.el8.x86_64                           9/9 
  Verifying        : copy-jdk-configs-3.7-1.el8.noarch                      1/9 
  Verifying        : java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64             2/9 
  Verifying        : java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64       3/9 
  Verifying        : java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64    4/9 
  Verifying        : javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b   5/9 
  Verifying        : lksctp-tools-1.0.18-3.el8.x86_64                       6/9 
  Verifying        : ttmkfdir-3.0.9-54.el8.x86_64                           7/9 
  Verifying        : tzdata-java-2020a-1.el8.noarch                         8/9 
  Verifying        : xorg-x11-fonts-Type1-7.5-19.el8.noarch                 9/9 
Installed products updated.

Removed:
  copy-jdk-configs-3.7-1.el8.noarch                                             
  java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64                                    
  java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64                              
  java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64                           
  javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b8c10bd.noarch             
  lksctp-tools-1.0.18-3.el8.x86_64                                              
  ttmkfdir-3.0.9-54.el8.x86_64                                                  
  tzdata-java-2020a-1.el8.noarch                                                
  xorg-x11-fonts-Type1-7.5-19.el8.noarch                                        

Complete!
[root@localhost cr140121]# yum install java-11-openjdk-jmods java-11-openjdk-src  java-11-openjdk-javadoc-zip java-11-openjdk-devel java-11-openjdk-headless java-11-openjdk
Last metadata expiration check: 0:33:47 ago on Wed 16 Sep 2020 05:18:08 AM EDT.
Dependencies resolved.
================================================================================
 Package                     Arch   Version                     Repo       Size
================================================================================
Installing:
 java-11-openjdk             x86_64 1:11.0.8.10-0.el8_2         AppStream 249 k
 java-11-openjdk-devel       x86_64 1:11.0.8.10-0.el8_2         AppStream 3.4 M
 java-11-openjdk-headless    x86_64 1:11.0.8.10-0.el8_2         AppStream  40 M
 java-11-openjdk-javadoc-zip x86_64 1:11.0.8.10-0.el8_2         AppStream  42 M
 java-11-openjdk-jmods       x86_64 1:11.0.8.10-0.el8_2         AppStream 322 M
 java-11-openjdk-src         x86_64 1:11.0.8.10-0.el8_2         AppStream  50 M
Installing dependencies:
 copy-jdk-configs            noarch 3.7-1.el8                   AppStream  27 k
 javapackages-filesystem     noarch 5.3.0-1.module_el8.0.0+11+5b8c10bd
                                                                AppStream  30 k
 lksctp-tools                x86_64 1.0.18-3.el8                BaseOS    100 k
 ttmkfdir                    x86_64 3.0.9-54.el8                AppStream  62 k
 tzdata-java                 noarch 2020a-1.el8                 AppStream 189 k
 xorg-x11-fonts-Type1        noarch 7.5-19.el8                  AppStream 522 k
Enabling module streams:
 javapackages-runtime               201801                                     

Transaction Summary
================================================================================
Install  12 Packages

Total download size: 459 M
Installed size: 612 M
Is this ok [y/N]: y
Downloading Packages:
(1/12): copy-jdk-configs-3.7-1.el8.noarch.rpm   533 kB/s |  27 kB     00:00    
(2/12): java-11-openjdk-11.0.8.10-0.el8_2.x86_6 2.4 MB/s | 249 kB     00:00    
(3/12): java-11-openjdk-devel-11.0.8.10-0.el8_2 3.1 MB/s | 3.4 MB     00:01    
(4/12): java-11-openjdk-javadoc-zip-11.0.8.10-0 4.1 MB/s |  42 MB     00:10    
(5/12): java-11-openjdk-headless-11.0.8.10-0.el 3.2 MB/s |  40 MB     00:12    
(6/12): javapackages-filesystem-5.3.0-1.module_  30 kB/s |  30 kB     00:01    
(7/12): ttmkfdir-3.0.9-54.el8.x86_64.rpm        1.7 MB/s |  62 kB     00:00    
(8/12): tzdata-java-2020a-1.el8.noarch.rpm      2.7 MB/s | 189 kB     00:00    
(9/12): xorg-x11-fonts-Type1-7.5-19.el8.noarch. 2.7 MB/s | 522 kB     00:00    
(10/12): lksctp-tools-1.0.18-3.el8.x86_64.rpm   2.1 MB/s | 100 kB     00:00    
(11/12): java-11-openjdk-src-11.0.8.10-0.el8_2. 5.8 MB/s |  50 MB     00:08    
(12/12): java-11-openjdk-jmods-11.0.8.10-0.el8_ 7.8 MB/s | 322 MB     00:41    
--------------------------------------------------------------------------------
Total                                            11 MB/s | 459 MB     00:42     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Running scriptlet: copy-jdk-configs-3.7-1.el8.noarch                      1/1 
  Running scriptlet: java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64    1/1 
  Preparing        :                                                        1/1 
  Installing       : javapackages-filesystem-5.3.0-1.module_el8.0.0+11+    1/12 
  Installing       : lksctp-tools-1.0.18-3.el8.x86_64                      2/12 
  Running scriptlet: lksctp-tools-1.0.18-3.el8.x86_64                      2/12 
  Installing       : tzdata-java-2020a-1.el8.noarch                        3/12 
  Installing       : ttmkfdir-3.0.9-54.el8.x86_64                          4/12 
  Installing       : xorg-x11-fonts-Type1-7.5-19.el8.noarch                5/12 
  Running scriptlet: xorg-x11-fonts-Type1-7.5-19.el8.noarch                5/12 
  Installing       : copy-jdk-configs-3.7-1.el8.noarch                     6/12 
  Installing       : java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_6    7/12 
  Running scriptlet: java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_6    7/12 
/var/lib/alternatives/java empty!
/var/lib/alternatives/jre_openjdk empty!
/var/lib/alternatives/jre_11 empty!
/var/lib/alternatives/jre_11_openjdk empty!

  Installing       : java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64            8/12 
  Running scriptlet: java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64            8/12 
  Installing       : java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64      9/12 
  Running scriptlet: java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64      9/12 
/var/lib/alternatives/javac empty!
/var/lib/alternatives/java_sdk_openjdk empty!
/var/lib/alternatives/java_sdk_11 empty!
/var/lib/alternatives/java_sdk_11_openjdk empty!

  Installing       : java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64     10/12 
  Installing       : java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x8   11/12 
  Running scriptlet: java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x8   11/12 
  Installing       : java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64       12/12 
  Running scriptlet: copy-jdk-configs-3.7-1.el8.noarch                    12/12 
  Running scriptlet: java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64           12/12 
  Running scriptlet: java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64     12/12 
  Running scriptlet: java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64       12/12 
  Verifying        : copy-jdk-configs-3.7-1.el8.noarch                     1/12 
  Verifying        : java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64            2/12 
  Verifying        : java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64      3/12 
  Verifying        : java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_6    4/12 
  Verifying        : java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x8    5/12 
  Verifying        : java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64      6/12 
  Verifying        : java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64        7/12 
  Verifying        : javapackages-filesystem-5.3.0-1.module_el8.0.0+11+    8/12 
  Verifying        : ttmkfdir-3.0.9-54.el8.x86_64                          9/12 
  Verifying        : tzdata-java-2020a-1.el8.noarch                       10/12 
  Verifying        : xorg-x11-fonts-Type1-7.5-19.el8.noarch               11/12 
  Verifying        : lksctp-tools-1.0.18-3.el8.x86_64                     12/12 
Installed products updated.

Installed:
  copy-jdk-configs-3.7-1.el8.noarch                                             
  java-11-openjdk-1:11.0.8.10-0.el8_2.x86_64                                    
  java-11-openjdk-devel-1:11.0.8.10-0.el8_2.x86_64                              
  java-11-openjdk-headless-1:11.0.8.10-0.el8_2.x86_64                           
  java-11-openjdk-javadoc-zip-1:11.0.8.10-0.el8_2.x86_64                        
  java-11-openjdk-jmods-1:11.0.8.10-0.el8_2.x86_64                              
  java-11-openjdk-src-1:11.0.8.10-0.el8_2.x86_64                                
  javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b8c10bd.noarch             
  lksctp-tools-1.0.18-3.el8.x86_64                                              
  ttmkfdir-3.0.9-54.el8.x86_64                                                  
  tzdata-java-2020a-1.el8.noarch                                                
  xorg-x11-fonts-Type1-7.5-19.el8.noarch                                        

Complete!


[sandreev@localhost cr140121]$ ./reproducer_script.sh 
iteration 0
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=4639, sleeping 20
killing eclipse
iteration 1
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=4796, sleeping 20
killing eclipse
iteration 2
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=4967, sleeping 20
killing eclipse
iteration 3
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=5132, sleeping 20
killing eclipse
iteration 4
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=5291, sleeping 20
killing eclipse
iteration 5
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=5457, sleeping 20
killing eclipse
iteration 6
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=5626, sleeping 20
killing eclipse
iteration 7
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=5788, sleeping 20
killing eclipse
iteration 8
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=5964, sleeping 20
killing eclipse
iteration 9
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=6125, sleeping 20
killing eclipse
iteration 10
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=6278, sleeping 20
killing eclipse
iteration 11
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=6458, sleeping 20
killing eclipse
iteration 12
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=6624, sleeping 20
killing eclipse
iteration 13
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=6784, sleeping 20
killing eclipse
iteration 14
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
^C
[sandreev@localhost cr140121]$ gedit eclipse/eclipse.ini 
[sandreev@localhost cr140121]$ ./reproducer_script.sh 
iteration 0
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=8010, sleeping 20
killing eclipse
iteration 1
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=8167, sleeping 20
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007f0cf30bef44, pid=8167, tid=8169
#
# JRE version: OpenJDK Runtime Environment 18.9 (11.0.8+10) (build 11.0.8+10-LTS)
# Java VM: OpenJDK 64-Bit Server VM 18.9 (11.0.8+10-LTS, mixed mode, sharing, tiered, compressed oops, serial gc, linux-amd64)
# Problematic frame:
# C  [libpthread.so.0+0xff44]  pthread_getcpuclockid+0x4
#
# Core dump will be written. Default location: Core dumps may be processed with "/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e" (or dumping to /home/sandreev/tmp/cr140121/core.8167)
#
# An error report file with more information is saved as:
# /home/sandreev/tmp/cr140121/hs_err_pid8167.log
#
# If you would like to submit a bug report, please visit:
#   https://bugreport.java.com/bugreport/crash.jsp
#
Exception in thread "main" java.io.IOException: Premature EOF
	at jdk.attach/sun.tools.attach.HotSpotVirtualMachine.readInt(HotSpotVirtualMachine.java:340)
	at jdk.attach/sun.tools.attach.VirtualMachineImpl.execute(VirtualMachineImpl.java:192)
	at jdk.attach/sun.tools.attach.HotSpotVirtualMachine.executeCommand(HotSpotVirtualMachine.java:309)
	at jdk.attach/sun.tools.attach.HotSpotVirtualMachine.remoteDataDump(HotSpotVirtualMachine.java:266)
	at jdk.jcmd/sun.tools.jstack.JStack.runThreadDump(JStack.java:130)
	at jdk.jcmd/sun.tools.jstack.JStack.main(JStack.java:109)
killing eclipse
iteration 2
removing stored tips state stored at: ~/.eclipse/org.eclipse.tips.state/
preparing empty workspace
starting eclipse
started eclipse, sleeping 20
WaylandCompositor requires eglBindWaylandDisplayWL, eglUnbindWaylandDisplayWL and eglQueryWaylandBuffer.
Nested Wayland compositor could not initialize EGL
eclipse has pid=8325, sleeping 20
^C
[sandreev@localhost cr140121]$ java -version
openjdk version "11.0.8" 2020-07-14 LTS
OpenJDK Runtime Environment 18.9 (build 11.0.8+10-LTS)
OpenJDK 64-Bit Server VM 18.9 (build 11.0.8+10-LTS, mixed mode, sharing)

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007f0cf30bef44, pid=8167, tid=8169
#
# JRE version: OpenJDK Runtime Environment 18.9 (11.0.8+10) (build 11.0.8+10-LTS)
# Java VM: OpenJDK 64-Bit Server VM 18.9 (11.0.8+10-LTS, mixed mode, sharing, tiered, compressed oops, serial gc, linux-amd64)
# Problematic frame:
# C  [libpthread.so.0+0xff44]  pthread_getcpuclockid+0x4
#
# Core dump will be written. Default location: Core dumps may be processed with "/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e" (or dumping to /home/sandreev/tmp/cr140121/core.8167)
#
# If you would like to submit a bug report, please visit:
#   https://bugreport.java.com/bugreport/crash.jsp
#

---------------  S U M M A R Y ------------

Command Line: -Dosgi.requiredJavaVersion=11 -Dosgi.dataAreaRequiresExplicitInit=true -Xmx12G -Xms1G -Xss5m -XX:ReservedCodeCacheSize=256m -XX:GCTimeRatio=99 -DmaxCompiledUnitsAtOnce=0 -Dxtext.qn.interning=true -Dxtext.skipSecondaryTypes=true -Dosgi.bundlefile.limit=100 -Declipse.log.size.max=20000 -Declipse.log.backup.max=50 -Dorg.eclipse.swt.internal.gtk.noThemingFixes -Dorg.eclipse.core.resources.disable_advanced_recursive_link_checks -Dorg.eclipse.wst.validation.ui.disable.validation.context.menu=true -Dfile.encoding=UTF8 -Dorg.eclipse.tips.startup.default=dialog -Dcom.sun.xml.bind.v2.bytecode.ClassTailor.noOptimize=true --add-modules=ALL-SYSTEM /home/sandreev/tmp/cr140121/eclipse//plugins/org.eclipse.equinox.launcher_1.5.700.v20200207-2156.jar -os linux -ws gtk -arch x86_64 -showsplash -launcher /home/sandreev/tmp/cr140121/eclipse/eclipse -name Eclipse --launcher.library /home/sandreev/tmp/cr140121/eclipse//plugins/org.eclipse.equinox.launcher.gtk.linux.x86_64_1.1.1200.v20200508-1552/eclipse_1801.so -startup /home/sandreev/tmp/cr140121/eclipse//plugins/org.eclipse.equinox.launcher_1.5.700.v20200207-2156.jar --launcher.appendVmargs -exitdata 38 -clean -data /tmp/cr140121_workspace/ -vm /usr/lib/jvm/java-11/bin/java -vmargs -Dosgi.requiredJavaVersion=11 -Dosgi.dataAreaRequiresExplicitInit=true -Xmx12G -Xms1G -Xss5m -XX:ReservedCodeCacheSize=256m -XX:GCTimeRatio=99 -DmaxCompiledUnitsAtOnce=0 -Dxtext.qn.interning=true -Dxtext.skipSecondaryTypes=true -Dosgi.bundlefile.limit=100 -Declipse.log.size.max=20000 -Declipse.log.backup.max=50 -Dorg.eclipse.swt.internal.gtk.noThemingFixes -Dorg.eclipse.core.resources.disable_advanced_recursive_link_checks -Dorg.eclipse.wst.validation.ui.disable.validation.context.menu=true -Dfile.encoding=UTF8 -Dorg.eclipse.tips.startup.default=dialog -Dcom.sun.xml.bind.v2.bytecode.ClassTailor.noOptimize=true --add-modules=ALL-SYSTEM -jar /home/sandreev/tmp/cr140121/eclipse//plugins/org.eclipse.equinox.launcher_1.5.700.v20200207-2156.jar

Host: Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz, 1 cores, 7G, CentOS Linux release 8.2.2004 (Core) 
Time: Wed Sep 16 06:07:05 2020 EDT elapsed time: 40 seconds (0d 0h 0m 40s)

---------------  T H R E A D  ---------------

Current thread (0x00007f0cec0b6000):  VMThread "VM Thread" [stack: 0x00007f0ccf7b7000,0x00007f0ccf8b7000] [id=8169]

Stack: [0x00007f0ccf7b7000,0x00007f0ccf8b7000],  sp=0x00007f0ccf8b57c8,  free space=1017k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [libpthread.so.0+0xff44]  pthread_getcpuclockid+0x4
V  [libjvm.so+0xe26ec5]  Thread::print_on(outputStream*, bool) const+0x55
V  [libjvm.so+0xe2bb80]  Threads::print_on(outputStream*, bool, bool, bool, bool)+0x1f0
V  [libjvm.so+0xe97c2b]  VM_Operation::evaluate()+0xeb
V  [libjvm.so+0xe9dd8e]  VMThread::evaluate_operation(VM_Operation*) [clone .constprop.71]+0x11e
V  [libjvm.so+0xe9e488]  VMThread::loop()+0x5b8
V  [libjvm.so+0xe9e7b6]  VMThread::run()+0x86
V  [libjvm.so+0xe2d01c]  Thread::call_run()+0x15c
V  [libjvm.so+0xbe9ce6]  thread_native_entry(Thread*)+0xf6
Comment 27 Simeon Andreev 2020-09-16 10:37:07 UTC 
The VM is given 16 GB VDI disk and 8 GB RAM, if that makes any difference whatsoever for reproduction.
Comment 28 Paulo Andrade 2020-09-22 10:59:49 UTC 
I can reproduce the issue. Will work on a test system that I can share.

As previously guessed -XX:-UseLinuxPosixThreadCPUClocks is a workaround,
but it might be too costly depending on pthread_getcpuclockid usage.
Comment 29 Paulo Andrade 2020-09-22 20:03:18 UTC 
Glibc has this:

/** For now disable debugging support.  */
#if 0
# define DEBUGGING_P __builtin_expect (__pthread_debug, 0)
# define INVALID_TD_P(pd) (DEBUGGING_P && __find_in_stack_list (pd) == NULL)
# define INVALID_NOT_TERMINATED_TD_P(pd) INVALID_TD_P (pd)
#else
# define DEBUGGING_P 0
/* Simplified test.  This will not catch all invalid descriptors but
   is better than nothing.  And if the test triggers the thread
   descriptor is guaranteed to be invalid.  */
# define INVALID_TD_P(pd) __builtin_expect ((pd)->tid <= 0, 0)
# define INVALID_NOT_TERMINATED_TD_P(pd) __builtin_expect ((pd)->tid < 0, 0)
#endif

So, there isn't a portable way to check if a random pointer is a valid
thread; could, somehow, manually call __find_in_stack_list(pd) ...

The invalid thread pointer looks like a valid thread pointer, just that it
points to unmapped area. Checking with some systemtap scripts, my guess is
that the animations in the eclipse welcome window creates threads from
libglib-2.0.so.0, libjavascriptcoregtk-4.0.so, swrast_dri.so, etc somehow
causes glibc to release some pthread internal data structures, causing the
jvm to keep a reference to a thread that has already exited. From my
understanding, most java threads are created detached, but a similar issue
could happen if calling pthread_join twice.

Possibly, a smaller time (the 'n' variable) in the script test.sh waits
before calling jstack, the more unlikely it is to crash, as less animations
will be shown, and less threads will be created.
Comment 32 Chris Williams 2020-11-11 21:40:20 UTC 
Red Hat Enterprise Linux 7 shipped it's final minor release on September 29th, 2020. 7.9 was the last minor releases scheduled for RHEL 7.
From intial triage it does not appear the remaining Bugzillas meet the inclusion criteria for Maintenance Phase 2 and will now be closed. 

From the RHEL life cycle page:
https://access.redhat.com/support/policy/updates/errata#Maintenance_Support_2_Phase
"During Maintenance Support 2 Phase for Red Hat Enterprise Linux version 7,Red Hat defined Critical and Important impact Security Advisories (RHSAs) and selected (at Red Hat discretion) Urgent Priority Bug Fix Advisories (RHBAs) may be released as they become available."

If this BZ was closed in error and meets the above criteria please re-open it flag for 7.9.z, provide suitable business and technical justifications, and follow the process for Accelerated Fixes:
https://source.redhat.com/groups/public/pnt-cxno/pnt_customer_experience_and_operations_wiki/support_delivery_accelerated_fix_release_handbook  

Feature Requests can re-opened and moved to RHEL 8 if the desired functionality is not already present in the product. 

Please reach out to the applicable Product Experience Engineer[0] if you have any questions or concerns.  

[0] https://bugzilla.redhat.com/page.cgi?id=agile_component_mapping.html&product=Red+Hat+Enterprise+Linux+7
Comment 33 Simeon Andreev 2020-11-12 07:20:09 UTC 
We've reproduced this problem on CentOS 8 (RHEL release unrelated OS) with the same OpenJDK version. The problem is in OpenJDK, and is not tied to a specific RHEL release.

Please re-open with targeting whatever RHEL version you still support, or clone respectively.
Comment 34 Mike Millson 2022-08-15 19:19:48 UTC 
Re-opening for RHEL 8.5.
Comment 41 Andrew Dinn 2023-02-09 09:28:18 UTC 
(In reply to Simeon Andreev from comment #33)
> We've reproduced this problem on CentOS 8 (RHEL release unrelated OS) with
> the same OpenJDK version. The problem is in OpenJDK, and is not tied to a
> specific RHEL release.
> 
> Please re-open with targeting whatever RHEL version you still support, or
> clone respectively.

I believe this is exactly the same problem as https://bugzilla.redhat.com/show_bug.cgi?id=1897150 i.e. the crash occurs after an application thread attaches and then exits without detaching. Do you agree that this is the root cause here?

If so then you are right to say that the problem is not tied to a specific RHEL release. However, I don't agree that this warrants the conclusion that the problem lies in OpenJDK -- for all the reasons mentioned in the BZ cited above. The problem is that the application is not using the JNI thread API in the manner it was designed for.

The only viable fix for this problem is for the app code to correct this misuse of the API. It is true that measures have been taken in later releases to detect this type of misuse and avoid the crash, at least in some cases. However, backporting those measures to this release is not an option given the complexity of the changes. The overriding priority is to maintain stability of the release for all existing deployments.
Comment 43 Simeon Andreev 2023-02-09 11:13:12 UTC 
> I believe this is exactly the same problem as
> https://bugzilla.redhat.com/show_bug.cgi?id=1897150 i.e. the crash occurs
> after an application thread attaches and then exits without detaching. Do
> you agree that this is the root cause here?
 
Seems so.

> If so then you are right to say that the problem is not tied to a specific
> RHEL release. However, I don't agree that this warrants the conclusion that
> the problem lies in OpenJDK -- for all the reasons mentioned in the BZ cited
> above. The problem is that the application is not using the JNI thread API
> in the manner it was designed for.

It cost us a not insignificant amount of time to find the problem and understand how to fix it. Including resorting to RHEL support, which might not be possible for other OpenJDK users. All the while, the crash on jstack was occasionally hindering analysis of hangs and deadlocks. If you deem the JDK code is on OK state (documentation, APIs resulting in crashes that are hard to reproduce and understand), then we'll just move on. We have the knowledge now on what not to do with the attach call.
Comment 44 Andrew Dinn 2023-02-10 09:57:12 UTC 
(In reply to Simeon Andreev from comment #43)
> > I believe this is exactly the same problem as
> > https://bugzilla.redhat.com/show_bug.cgi?id=1897150 i.e. the crash occurs
> > after an application thread attaches and then exits without detaching. Do
> > you agree that this is the root cause here?
>  
> Seems so.

In that case I believe we will need to close this BZ as "can't fix".

> > If so then you are right to say that the problem is not tied to a specific
> > RHEL release. However, I don't agree that this warrants the conclusion that
> > the problem lies in OpenJDK -- for all the reasons mentioned in the BZ cited
> > above. The problem is that the application is not using the JNI thread API
> > in the manner it was designed for.
> 
> It cost us a not insignificant amount of time to find the problem and
> understand how to fix it. Including resorting to RHEL support, which might
> not be possible for other OpenJDK users. All the while, the crash on jstack
> was occasionally hindering analysis of hangs and deadlocks. If you deem the
> JDK code is on OK state (documentation, APIs resulting in crashes that are
> hard to reproduce and understand), then we'll just move on. We have the
> knowledge now on what not to do with the attach call.

I appreciate the difficulty this has caused you and I am sure an awareness that this can happen is why later releases have led to making the JVM more robust in detecting and handling this misuse. However, as I stated previously, that does not mean that we are in a position to backport those same JVM changes to any given update release. The primary requirement for an update projects is to maintain stability for all users rather than fix a bug that affects a few users (actually affects them rather than potentially affects them) and the priority of that requirement increases with the lifetime of the project.
Comment 46 RHEL Program Management 2023-09-12 21:49:58 UTC 
Issue migration from Bugzilla to Jira is in process at this time. This will be the last message in Jira copied from the Bugzilla bug.
Comment 47 RHEL Program Management 2023-09-12 21:51:27 UTC 
This BZ has been automatically migrated to the issues.redhat.com Red Hat Issue Tracker. All future work related to this report will be managed there.

Due to differences in account names between systems, some fields were not replicated.  Be sure to add yourself to Jira issue's "Watchers" field to continue receiving updates and add others to the "Need Info From" field to continue requesting information.

To find the migrated issue, look in the "Links" section for a direct link to the new issue location. The issue key will have an icon of 2 footprints next to it, and begin with "RHEL-" followed by an integer.  You can also find this issue by visiting https://issues.redhat.com/issues/?jql= and searching the "Bugzilla Bug" field for this BZ's number, e.g. a search like:

"Bugzilla Bug" = 1234567

In the event you have trouble locating or viewing this issue, you can file an issue by sending mail to rh-issues. You can also visit https://access.redhat.com/articles/7032570 for general account information.