Bug 1844875 - PKI spawn results in SIGABRT
Summary: PKI spawn results in SIGABRT
Keywords:
Status: CLOSED RAWHIDE
Alias: None
Product: Fedora
Classification: Fedora
Component: opencryptoki
Version: rawhide
Hardware: aarch64
OS: Linux
unspecified
unspecified
Target Milestone: ---
Assignee: Dan Horák
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks: 1852999
TreeView+ depends on / blocked
 
Reported: 2020-06-07 18:46 UTC by David Sastre Medina
Modified: 2020-07-01 17:38 UTC (History)
16 users (show)

Fixed In Version: opencryptoki-3.14.0-3.fc33.
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1852999 (view as bug list)
Environment:
Last Closed: 2020-07-01 17:36:10 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
coredump (13.57 MB, application/x-lz4)
2020-06-07 18:46 UTC, David Sastre Medina
no flags Details
hs_err_pid.log (103.65 KB, text/plain)
2020-06-07 18:48 UTC, David Sastre Medina
no flags Details
Backtrace (88.56 KB, text/plain)
2020-06-10 07:41 UTC, David Sastre Medina
no flags Details

Description David Sastre Medina 2020-06-07 18:46:12 UTC
Created attachment 1695897 [details]
coredump

Description of problem:

Deployment of FreeIPA in a Raspberry Pi 4B using the ansible-freeipa upstream project
results in failure. The Java process generates a coredump after a SIGABRT

There probably is a segmentation fault (SIGSEGV) that is caught by the JVM, which results
in JVM writing a hs_err_pid.log and then terminating the process with an abort() call which
forces a core dump and SIGABRT.

Version-Release number of selected component (if applicable):
[root@ipa ~]# rpm -qa | grep freeipa
freeipa-client-common-4.8.6-2.fc33.noarch
freeipa-healthcheck-core-0.5-4.fc33.noarch
freeipa-server-common-4.8.6-2.fc33.noarch
freeipa-selinux-4.8.6-2.fc33.noarch
freeipa-common-4.8.6-2.fc33.noarch
freeipa-client-4.8.6-2.fc33.aarch64
freeipa-server-4.8.6-2.fc33.aarch64
freeipa-server-dns-4.8.6-2.fc33.noarch

How reproducible:
Consistently.

Steps to Reproduce:
1. Install a Fedora Server Minimal on a RPi4B (the listed compose was the latest at the tim eof installation)

$ sudo fedora-arm-image-installer --image=Fedora-Minimal-Rawhide-20200530.n.0.aarch64.raw.xz \
  --media=/dev/sdb --addconsole --addkey=/some/key/id_ed25519.pub \
  --resizefs --target=rpi3

2. Update packages

# dnf upgrade --refresh

3. From another machine, run the following playbook:

- name: Playbook to configure IPA servers
  hosts: ipaserver
  become: true
  no_log: 'False'
  gather_facts: 'True'
  environment:
    PKISPAWN_STARTUP_TIMEOUT_SECONDS: 1500
  roles:
    - role: ipaserver
      state: present

Actual results:

Playbook fails with:

TASK [ipaserver : Install - Setup CA] **************************************************************************************************************                                                                                           
Sunday 07 June 2020  19:57:44 +0200 (0:00:15.806)       0:03:47.421 ***********                                                                                                                                                                
fatal: [192.168.2.2]: FAILED! => {                         
    "changed": false,                                      
    "rc": 1                                                
}                                                          

MSG:                                                       

MODULE FAILURE                                             
See stdout/stderr for the exact error                                                                                  


MODULE_STDERR:                                             

Failed to configure CA instance: CalledProcessError(Command ['/usr/sbin/pkispawn', '-s', 'CA', '-f', '/tmp/tmp1nj7n9dx'] returned non-zero exit status 1: 'Notice: Trust flag u is set automatically if the private key is present.\nERROR: Cal
ledProcessError: Command \'[\'sudo\', \'-u\', \'pkiuser\', \'/usr/lib/jvm/jre-1.8.0-openjdk/bin/java\', \'-classpath\', \'/usr/share/tomcat/bin/tomcat-juli.jar:/usr/share/java/tomcat-servlet-api.jar:/usr/share/pki/ca/webapps/ca/WEB-INF/lib
/*:/var/lib/pki/pki-tomcat/common/lib/*:/usr/share/pki/lib/*\', \'-Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory\', \'-Dcatalina.base=/var/lib/pki/pki-tomcat\', \'-Dcatalina.home=/usr/share/tomcat\', \'-Djava
.endorsed.dirs=\', \'-Djava.io.tmpdir=/var/lib/pki/pki-tomcat/temp\', \'-Djava.util.logging.config.file=/etc/pki/pki-tomcat/logging.properties\', \'-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager\', \'org.dogtagpki.server
.cli.PKIServerCLI\', \'ca-db-init\', \'--setup-schema\', \'--create-database\', \'--create-base\', \'--create-containers\', \'--setup-db-manager\', \'--setup-vlv-indexes\']\' died with <Signals.SIGABRT: 6>.\n  File "/usr/lib/python3.9/site
-packages/pki/server/pkispawn.py", line 562, in main\n    scriptlet.spawn(deployer)\n  File "/usr/lib/python3.9/site-packages/pki/server/deployment/scriptlets/configuration.py", line 797, in spawn\n    subsystem.init_database(\n  File "/us
r/lib/python3.9/site-packages/pki/server/subsystem.py", line 902, in init_database\n    self.run(cmd, as_current_user=as_current_user)\n  File "/usr/lib/python3.9/site-packages/pki/server/subsystem.py", line 980, in run\n    subprocess.run
(cmd, check=True)\n  File "/usr/lib64/python3.9/subprocess.py", line 524, in run\n    raise CalledProcessError(retcode, process.args,\n\n')
See the installation logs and the following files/directories for more information:                                                                                                                                                            
  /var/log/pki/pki-tomcat                                  
Traceback (most recent call last):                         
  File "/usr/lib/python3.9/site-packages/ipaserver/install/dogtaginstance.py", line 193, in spawn_instance                                                                                                                                     
    ipautil.run(args, nolog=nolog_list)                                                                                
  File "/usr/lib/python3.9/site-packages/ipapython/ipautil.py", line 597, in run                                                                                                                                                               
    raise CalledProcessError(                              
ipapython.ipautil.CalledProcessError: CalledProcessError(Command ['/usr/sbin/pkispawn', '-s', 'CA', '-f', '/tmp/tmp1nj7n9dx'] returned non-zero exit status 1: 'Notice: Trust flag u is set automatically if the private key is present.\nERROR
: CalledProcessError: Command \'[\'sudo\', \'-u\', \'pkiuser\', \'/usr/lib/jvm/jre-1.8.0-openjdk/bin/java\', \'-classpath\', \'/usr/share/tomcat/bin/tomcat-juli.jar:/usr/share/java/tomcat-servlet-api.jar:/usr/share/pki/ca/webapps/ca/WEB-IN
F/lib/*:/var/lib/pki/pki-tomcat/common/lib/*:/usr/share/pki/lib/*\', \'-Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory\', \'-Dcatalina.base=/var/lib/pki/pki-tomcat\', \'-Dcatalina.home=/usr/share/tomcat\', \'-
Djava.endorsed.dirs=\', \'-Djava.io.tmpdir=/var/lib/pki/pki-tomcat/temp\', \'-Djava.util.logging.config.file=/etc/pki/pki-tomcat/logging.properties\', \'-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager\', \'org.dogtagpki.s
erver.cli.PKIServerCLI\', \'ca-db-init\', \'--setup-schema\', \'--create-database\', \'--create-base\', \'--create-containers\', \'--setup-db-manager\', \'--setup-vlv-indexes\']\' died with <Signals.SIGABRT: 6>.\n  File "/usr/lib/python3.9
/site-packages/pki/server/pkispawn.py", line 562, in main\n    scriptlet.spawn(deployer)\n  File "/usr/lib/python3.9/site-packages/pki/server/deployment/scriptlets/configuration.py", line 797, in spawn\n    subsystem.init_database(\n  File
 "/usr/lib/python3.9/site-packages/pki/server/subsystem.py", line 902, in init_database\n    self.run(cmd, as_current_user=as_current_user)\n  File "/usr/lib/python3.9/site-packages/pki/server/subsystem.py", line 980, in run\n    subproces
s.run(cmd, check=True)\n  File "/usr/lib64/python3.9/subprocess.py", line 524, in run\n    raise CalledProcessError(retcode, process.args,\n\n')

During handling of the above exception, another exception occurred:                                                    

Traceback (most recent call last):                         
  File "<stdin>", line 102, in <module>                                                                                
  File "<stdin>", line 94, in _ansiballz_main                                                                          
  File "<stdin>", line 40, in invoke_module                                                                            
  File "/usr/lib64/python3.9/runpy.py", line 210, in run_module                                                        
    return _run_module_code(code, init_globals, run_name, mod_spec)                                                    
  File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code                                                   
    _run_code(code, mod_globals, init_globals,                                                                         
  File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code                                                          
    exec(code, run_globals)                                
  File "/tmp/ansible_ipaserver_setup_ca_payload_my9x0p62/ansible_ipaserver_setup_ca_payload.zip/ansible/modules/ipaserver_setup_ca.py", line 355, in <module>
  File "/tmp/ansible_ipaserver_setup_ca_payload_my9x0p62/ansible_ipaserver_setup_ca_payload.zip/ansible/modules/ipaserver_setup_ca.py", line 317, in main
  File "/usr/lib/python3.9/site-packages/ipaserver/install/ca.py", line 338, in install_step_0
    ca.configure_instance(                                                                                                                                                                                                                     
  File "/usr/lib/python3.9/site-packages/ipaserver/install/cainstance.py", line 482, in configure_instance                                                                                                                                     
    self.start_creation(runtime=runtime)                                                                               
  File "/usr/lib/python3.9/site-packages/ipaserver/install/service.py", line 603, in start_creation                                                                                                                                            
    run_step(full_msg, method)                             
  File "/usr/lib/python3.9/site-packages/ipaserver/install/service.py", line 589, in run_step                                                                                                                                                  
    method()                                               
  File "/usr/lib/python3.9/site-packages/ipaserver/install/cainstance.py", line 596, in __spawn_instance                                                                                                                                       
    DogtagInstance.spawn_instance(                         
  File "/usr/lib/python3.9/site-packages/ipaserver/install/dogtaginstance.py", line 195, in spawn_instance                                                                                                                                     
    self.handle_setup_error(e)                             
  File "/usr/lib/python3.9/site-packages/ipaserver/install/dogtaginstance.py", line 501, in handle_setup_error                                                                                                                                 
    raise RuntimeError("%s configuration failed." % self.subsystem)                                                    
RuntimeError: CA configuration failed.

Expected results:

FreeIPA can be installed using ansible-freeipa

Additional info:

Find attached the following files:

[root@ipa ~]# coredumpctl
TIME                            PID   UID   GID SIG COREFILE  EXE
Sun 2020-06-07 19:58:22 CEST   3380    17    17   6 present   /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b02-0.0.ea.fc33.aarch64/jre/bin/java

[root@ipa ~]# ll /tmp/hsperfdata_pkiuser/hs_err_pid3380.log
-rw-r--r--. 1 pkiuser pkiuser 106136 Jun  7 19:58 /tmp/hsperfdata_pkiuser/hs_err_pid3380.log

Running gdb on the coredump to show full backtrace:

[root@ipa ~]# coredumpctl gdb                                                                                                                                                                                                          [72/112]           PID: 3380 (java)                                                                                                                                                                                                                    
           UID: 17 (pkiuser)                                                                                                                                                                                                                   
           GID: 17 (pkiuser)                                                                                                                                                                                                                   
        Signal: 6 (ABRT)                                                                                                                                                                                                                       
     Timestamp: Sun 2020-06-07 19:58:15 CEST (5min ago)                                                                                                                                                                                        
  Command Line: /usr/lib/jvm/jre-1.8.0-openjdk/bin/java -classpath /usr/share/tomcat/bin/tomcat-juli.jar:/usr/share/java/tomcat-servlet-api.jar:/usr/share/pki/ca/webapps/ca/WEB-INF/lib/*:/var/lib/pki/pki-tomcat/common/lib/*:/usr/share/pki/
lib/* -Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory -Dcatalina.base=/var/lib/pki/pki-tomcat -Dcatalina.home=/usr/share/tomcat -Djava.endorsed.dirs= -Djava.io.tmpdir=/var/lib/pki/pki-tomcat/temp -Djava.util.logging.config.file=/etc/pki/pki-tomcat/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager org.dogtagpki.server.cli.PKIServerCLI ca-db-init --setup-schema --create-database --create-base --create-containers
 --setup-db-manager --setup-vlv-indexes                                                                                                                                                                                                            Executable: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b02-0.0.ea.fc33.aarch64/jre/bin/java                                                                                                                                                 
 Control Group: /user.slice/user-0.slice/session-1.scope                                                                                                                                                                                                 Unit: session-1.scope                                                                                                                                                                                                                
         Slice: user-0.slice                                                                                                                                                                                                                   
       Session: 1                                                                                                                                                                                                                              
     Owner UID: 0 (root)                                                                                                                                                                                                                       
       Boot ID: 6bfd705cc8c74adeb269ec9069e2f790                                                                                                                                                                                               
    Machine ID: add0c325808f4bd59a09acef6b2e11f7                                                                                                                                                                                               
      Hostname: ipa.multicats.org                                                                                                                                                                                                              
       Storage: /var/lib/systemd/coredump/core.java.17.6bfd705cc8c74adeb269ec9069e2f790.3380.1591552695000000000000.lz4                                                                                                                        
       Message: Process 3380 (java) of user 17 dumped core.                                                                                                                                                                                    
                                                                                                                                                                                                                                               
                Stack trace of thread 3381:                                                                                                                                                                                                    
                #0  0x0000ffffb9650758 raise (libc.so.6 + 0x37758)                                                                                                                                                                             
                #1  0x0000ffffb963cf8c abort (libc.so.6 + 0x23f8c)                                                                                                                                                                             
                #2  0x0000ffffb9069704 _ZN2os5abortEb (libjvm.so + 0x832704)                                                                                                                                                                   
                #3  0x0000ffffb9266f68 _ZN7VMError14report_and_dieEv (libjvm.so + 0xa2ff68)                                                                                                                                                    
                #4  0x0000ffffb907391c JVM_handle_linux_signal (libjvm.so + 0x83c91c)                                                                                                                                                          
                #5  0x0000ffffb906699c _Z13signalHandleriP9siginfo_tPv (libjvm.so + 0x82f99c)                                                                                                                                                  
                #6  0x0000ffffb97ee5c8 n/a (linux-vdso.so.1 + 0x5c8)                                                                                                                                                                           
                #7  0x0000ffffb97ee5c8 n/a (linux-vdso.so.1 + 0x5c8)                                                                                                                                                                           
                #8  0x0000ffffa1163ae4 bt_destroy (libopencryptoki.so + 0xfae4)                                                                                                                                                                
                #9  0x0000ffffa1185278 n/a (libopencryptoki.so + 0x31278)                                                                                                                                                                      
                                                                                                                                                                                                                                               
GNU gdb (GDB) Fedora 9.1-7.fc33                                                                                                                                                                                                                
Copyright (C) 2020 Free Software Foundation, Inc.                                                                                                                                                                                              
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>                                                                                                                                                                  
This is free software: you are free to change and redistribute it.                                                                                                                                                                             
There is NO WARRANTY, to the extent permitted by law.                                                                                                                                                                                          
Type "show copying" and "show warranty" for details.                                                                                                                                                                                           
This GDB was configured as "aarch64-redhat-linux-gnu".                                                                                                                                                                                         
Type "show configuration" for configuration details.                                                                                                                                                                                           
For bug reporting instructions, please see:                                                                                                                                                                                                    
<http://www.gnu.org/software/gdb/bugs/>.                                                                                                                                                                                                       
Find the GDB manual and other documentation resources online at:                                                                                                                                                                               
    <http://www.gnu.org/software/gdb/documentation/>.                                                                                                                                                                                          
                                                                                                                                                                                                                                               
For help, type "help".                                                                                                                                                                                                                         
Type "apropos word" to search for commands related to "word"...                                                                                                                                                                                
/etc/gdbinit:9: Error in sourced command file:                                                                                                                                                                                                 
Scripting in the "Python" language is not supported in this copy of GDB.                                                                                                                                                                       
Reading symbols from /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b02-0.0.ea.fc33.aarch64/jre/bin/java...
Reading symbols from /usr/lib/debug/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b02-0.0.ea.fc33.aarch64/jre/bin/java-1.8.0.252.b02-0.0.ea.fc33.aarch64.debug...                                                                                   
                                                                                                                                                                                                                                               
[New LWP 3381]                                                                                                                                                                                                                                 
[New LWP 3382]                                                                                                                                                                                                                                 
[New LWP 3384]                                                                                                                                                                                                                                 
[New LWP 3391]                                                                                                                                                                                                                                 
[New LWP 3390]                                                                                                                                                                                                                                 
[New LWP 3394]                                                                                                                                                                                                                                 
[New LWP 3393]                                                                                                                                                                                                                                 
[New LWP 3386]                                                                                                                                                                                                                                 
[New LWP 3388]                                                                                                                                                                                                                                 
[New LWP 3389]                                                                                                                                                                                                                                 
[New LWP 3387]                                                                                                                                                                                                                                 
[New LWP 3380]                                                                                                                                                                                                                                 
[New LWP 3385]                                                                                                                                                                                                                                 
[New LWP 3392]                                                                                                                                                                                                                                 
[New LWP 3383]                                                                                                                                                                                                                                 
[Thread debugging using libthread_db enabled]                                                                                                                                                                                                  
Using host libthread_db library "/lib64/libthread_db.so.1".                                                                                                                                                                                    
Core was generated by `/usr/lib/jvm/jre-1.8.0-openjdk/bin/java -classpath /usr/share/tomcat/bin/tomcat'.                                                                                                                                       
Program terminated with signal SIGABRT, Aborted.                                                                                                                                                                                               
#0  0x0000ffffb9650758 in raise () from /lib64/libc.so.6                                                                                                                                                                                       
[Current thread is 1 (Thread 0xffffb855e160 (LWP 3381))]                                                                                                                                                                                       
Missing separate debuginfos, use: dnf debuginfo-install cyrus-sasl-lib-2.1.27-5.fc33.aarch64 glibc-2.31.9000-13.fc33.aarch64 jss-4.6.4-1.fc33.aarch64 keyutils-libs-1.6-4.fc32.aarch64 krb5-libs-1.18.2-3.fc33.aarch64 libcom_err-1.45.6-2.fc33
.aarch64 libffi-3.1-25.fc33.aarch64 libgcc-10.1.1-1.fc33.aarch64 libselinux-3.0-5.fc33.aarch64 libstdc++-10.1.1-1.fc33.aarch64 libtasn1-4.16.0-1.fc32.aarch64 libxcrypt-4.4.16-3.fc33.aarch64 nspr-4.25.0-1.fc33.aarch64 nss-3.53.0-1.fc33.aarc
h64 nss-softokn-3.53.0-1.fc33.aarch64 nss-softokn-freebl-3.53.0-1.fc33.aarch64 nss-util-3.53.0-1.fc33.aarch64 opencryptoki-libs-3.14.0-2.fc33.aarch64 openldap-2.4.47-4.fc32.aarch64 openssl-libs-1.1.1g-8.fc33.aarch64 p11-kit-0.23.20-1.fc32.
aarch64 p11-kit-trust-0.23.20-1.fc32.aarch64 pcre2-10.35-3.fc33.aarch64 softhsm-2.6.1-3.fc33.aarch64 sqlite-libs-3.32.1-1.fc33.aarch64 sssd-client-2.3.0-2.fc33.aarch64 zlib-1.2.11-21.fc32.aarch64                                            
(gdb) info registers                                                                                                                                                                                                                           
x0             0x0                 0                                                                                                                                                                                                           
x1             0xffffb855ac88      281473774365832                                                                                                                                                                                             
x2             0x0                 0                                                                                                                                                                                                           
x3             0x8                 8                                                                                                                                                                                                           
x4             0x0                 0                                                                                                                                                                                                           
x5             0xffffb9788000      281473793425408                                                                                                                                                                                             
x6             0xffffffffffffffff  -1                                                                                                                                                                                                          
x7             0xffffffffffffffff  -1                                                                                                                                                                                                          
x8             0x87                135                                                                                                                                                                                                         
x9             0x6                 6                                                                                                                                                                                                           
x10            0xffffffffffffffff  -1                                                                                                                                                                                                          
x11            0xffffffffffffffff  -1                                                                                                                                                                                                          
x12            0xffffffffffffffff  -1                                                                                                                                                                                                          
x13            0xffffffffffffffff  -1                                                                                                                                                                                                          
x14            0xffffffffffffffff  -1                                                                                                                                                                                                          
x15            0xffffffffffffffff  -1                                                                                                                                                                                                          
x16            0xffffffffffffffff  -1                                                                                                                                                                                                          
x17            0xffffffffffffffff  -1                                                                                                                                                                                                          
x18            0xffffb855ac88      281473774365832                                                                                                                                                                                             
x19            0xffffb978b000      281473793437696                                                                                                                                                                                             
x20            0xffffb855e160      281473774379360                                                                                                                                                                                             
x21            0xffffb978b690      281473793439376                                                                                                                                                                                             
x22            0xffffb953bbc4      281473791015876                                                                                                                                                                                             
x23            0xffffb855b088      281473774366856
x24            0xffffb958cfa0      281473791348640                                                                                                                                                                                             
x25            0xffffb95166a8      281473790863016                                                                                                                                                                                             
x26            0xffffb855af60      281473774366560                                                                                                                                                                                             
x27            0xffffa1689000      281473389727744                                                                                                                                                                                             
x28            0xffffb4566270      281473707303536                                                                                                                                                                                             
x29            0xffffb855ac70      281473774365808                                                                                                                                                                                             
x30            0xffffb963cf8c      281473792069516                                                                                                                                                                                             
sp             0xffffb855ac70      0xffffb855ac70                                                                                                                                                                                              
pc             0xffffb9650758      0xffffb9650758 <raise+216>                                                                                                                                                                                  
cpsr           0x1000              [ EL=0 SSBS ]                                                                                                                                                                                               
fpsr           0x10                16                                                                                                                                                                                                          
fpcr           0x0                 0                                                                                                                                                                                                           
(gdb) bt full                                                                                                                                                                                                                           [1/169]
#0  0x0000ffffb9650758 in raise () from /lib64/libc.so.6                                                                                                                                                                                       
No symbol table info available.                                                                                                                                                                                                                
#1  0x0000ffffb963cf8c in abort () from /lib64/libc.so.6                                                                                                                                                                                       
No symbol table info available.                                                                                                                                                                                                                
#2  0x0000ffffb9069704 in os::abort (dump_core=true) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.252.b02-0.0.ea.fc33.aarch64/openjdk/hotspot/src/os/linux/vm/os_linux.cpp:1572                                                                  
No locals.                                                                                                                                                                                                                                     
#3  0x0000ffffb9266f68 in VMError::report_and_die (this=this@entry=0xffffb855b088) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.252.b02-0.0.ea.fc33.aarch64/openjdk/hotspot/src/share/vm/utilities/vmError.cpp:1107                              
        dump_core = <optimized out>                                                                                                                                                                                                            
        skip_os_abort = true                                                                                                                                                                                                                   
        buffer = "/tmp/hsperfdata_pkiuser/hs_err_pid3380.log", '\000' <repeats 1957 times>                                                                                                                                                     
        recursive_error_count = 0                                                                                                                                                                                                              
        out_done = true                                                                                                                                                                                                                        
        log_done = true                                                                                                                                                                                                                        
        transmit_report_done = true                                                                                                                                                                                                            
        mytid = <optimized out>                                                                                                                                                                                                                
        skip_OnError = false                                                                                                                                                                                                                   
        skip_replay = false                                                                                                                                                                                                                    
        skip_bug_url = true                                                                                                                                                                                                                    
#4  0x0000ffffb907391c in JVM_handle_linux_signal (sig=11, info=info@entry=0xffffb855b1a0, ucVoid=ucVoid@entry=0xffffb855b220, abort_if_unrecognized=abort_if_unrecognized@entry=1)                                                            
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.252.b02-0.0.ea.fc33.aarch64/openjdk/hotspot/src/os_cpu/linux_aarch64/vm/os_linux_aarch64.cpp:410                                                                                                
        uc = 0xffffb855b220                                                                                                                                                                                                                    
        t = 0xffffb404e800                                                                                                                                                                                                                     
        shm = {<StackObj> = {<No data fields>}, _thread = 0xffffb404e800}                                                                                                                                                                      
        thread = <optimized out>                                                                                                                                                                                                               
        vmthread = <optimized out>                                                                                                                                                                                                             
        stub = <optimized out>                                                                                                                                                                                                                 
        pc = <optimized out>                                                                                                                                                                                                                   
        newset = {__val = {1024, 0, 1591264688, 281473774368016, 281473793641696, 281473774369400, 152, 281473774381280, 281473707575888, 281473707757584, 2, 1, 281473774369456, 0, 281473793641636, 1}}                                      
        err = {<StackObj> = {<No data fields>}, _id = 11, _message = 0x0, _detail_msg = 0x0, _thread = 0xffffb404e800, _pc = 0xffffa1163b00 <bt_destroy+60> "bN@\251?", _siginfo = 0xffffb855b1a0, _context = 0xffffb855b220,                  
          _filename = 0x0, _lineno = 0, _current_step = 0, _current_step_info = 0xffffb92eb310 "", _verbose = 1, static first_error = 0xffffb855b088, static first_error_tid = 281473774379360, static coredump_status = true,                 
          static coredump_message = "/tmp/hsperfdata_pkiuser/core or core.3380", '\000' <repeats 1958 times>, _size = 0, static out = {<outputStream> = {<ResourceObj> = {<No data fields>},                                                   
              _vptr.outputStream = 0xffffb948abb8 <vtable for fdStream+16>, _indentation = 0, _width = 80, _position = 0, _newlines = 20, _precount = 798, _stamp = {_counter = 0}}, _fd = 1, _need_close = false},                            
          static log = {<outputStream> = {<ResourceObj> = {<No data fields>}, _vptr.outputStream = 0xffffb948abb8 <vtable for fdStream+16>, _indentation = 0, _width = 80, _position = 0, _newlines = 1262, _precount = 106136, _stamp = {     
                _counter = 0}}, _fd = -1, _need_close = false}}                                                                                                                                                                                
        buf = <optimized out>                                                                                                                                                                                                                  
#5  0x0000ffffb906699c in signalHandler (sig=<optimized out>, info=0xffffb855b1a0, uc=0xffffb855b220) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.252.b02-0.0.ea.fc33.aarch64/openjdk/hotspot/src/os/linux/vm/os_linux.cpp:4552                 
        orig_errno = 13                                                                                                                                                                                                                        
#6  <signal handler called>                                                                                                                                                                                                                    
No symbol table info available.
#7  0x0000ffffa1163b00 in bt_destroy () from /usr/lib64/pkcs11/libopencryptoki.so                                                                                                                                                              
No symbol table info available.                                                                                                                                                                                                                
#8  0x0000ffffa11616a8 in C_Initialize () from /usr/lib64/pkcs11/libopencryptoki.so                                                                                                                                                            
No symbol table info available.                                                                                                                                                                                                                
#9  0x0000ffffa15ee490 in initialize_module_inlock_reentrant () from /lib64/p11-kit-proxy.so                                                                                                                                                   
No symbol table info available.                                                                                                                                                                                                                
#10 0x0000ffffa15ee5f4 in managed_C_Initialize () from /lib64/p11-kit-proxy.so                                                                                                                                                                 
No symbol table info available.                                                                                                                                                                                                                
#11 0x0000ffffa15f0f08 in p11_kit_modules_initialize () from /lib64/p11-kit-proxy.so                                                                                                                                                           
No symbol table info available.                                                                                                                                                                                                                
#12 0x0000ffffa15f5248 in proxy_C_Initialize () from /lib64/p11-kit-proxy.so                                                                                                                                                                   
No symbol table info available.                                                                                                                                                                                                                
#13 0x0000ffffa1a52350 in secmod_ModuleInit () from /lib64/libnss3.so                                                                                                                                                                          
No symbol table info available.                                                                                                                                                                                                                
#14 0x0000ffffa1a52950 in secmod_LoadPKCS11Module () from /lib64/libnss3.so                                                                                                                                                                    
--Type <RET> for more, q to quit, c to continue without paging--                                                                                                                                                                               
No symbol table info available.                                                                                                                                                                                                                
#15 0x0000ffffa1a5eb0c in SECMOD_LoadModule () from /lib64/libnss3.so                                                                                                                                                                          
No symbol table info available.                                                                                                                                                                                                                
#16 0x0000ffffa1a5ec4c in SECMOD_LoadModule () from /lib64/libnss3.so                                                                                                                                                                          
No symbol table info available.                                                                                                                                                                                                                
#17 0x0000ffffa1a2ae4c in nss_Init () from /lib64/libnss3.so                                                                                                                                                                                   
No symbol table info available.                                                                                                                                                                                                                
#18 0x0000ffffa1a2b264 in NSS_InitReadWrite () from /lib64/libnss3.so                                                                                                                                                                          
No symbol table info available.                                                                                                                                                                                                                
#19 0x0000ffffa1c1171c in Java_org_mozilla_jss_CryptoManager_initializeAllNative2 () from /usr/lib64/jss/libjss4.so                                                                                                                            
No symbol table info available.                                                                                                                                                                                                                
#20 0x0000ffffab88a49c in ?? ()                                                                                                                                                                                                                
No symbol table info available.                                                                                                                                                                                                                
#21 0x00000000ecd09948 in ?? ()                                                                                                                                                                                                                
No symbol table info available.                                                                                                                                                                                                                
Backtrace stopped: not enough registers or memory available to unwind further

Comment 2 David Sastre Medina 2020-06-07 18:48:08 UTC
Created attachment 1695899 [details]
hs_err_pid.log

Comment 3 Alexander Bokovoy 2020-06-07 19:10:40 UTC
Let's move to opencryptoki for the analysis first since it crashes in that component after it was loaded by the p11-kit-proxy.

Note that FreeIPA disables softhsm2 in p11-kit-proxy but we never had any issue with opencryptoki in past.

Comment 4 Dan Horák 2020-06-09 12:15:53 UTC
David, could you generate a better backtrace after installing the missing debuginfos (primarily opencryptoki)?

Comment 5 David Sastre Medina 2020-06-10 07:39:02 UTC
For reference, the additional debuginfo packages installed are:

[root@ipa ~]# dnf history info last                                                                                                                                                                                                   [18/3991]
Transaction ID : 13                                                                                                                                                                                                                            
Begin time     : Tue 02 Jun 2020 02:04:58 CEST                                                                                                                                                                                                 
Begin rpmdb    : 772:c2198579a48126e70e38b307c2a9fe847d2dddf0                                                                                                                                                                                  
End time       : Tue 02 Jun 2020 02:07:17 CEST (139 seconds)                                                                                                                                                                                   
End rpmdb      : 829:6748e03c9e1e637e999e6171c28a9ca9dc4ef203                                                                                                                                                                                  
User           : root <root>                                                                                                                                                                                                                   
Return-Code    : Success                                                                                                                                                                                                                       
Releasever     : 33                                                                                                                                                                                                                            
Command Line   : debuginfo-install cyrus-sasl-lib-2.1.27-5.fc33.aarch64 glibc-2.31.9000-13.fc33.aarch64 jss-4.6.4-1.fc33.aarch64 keyutils-libs-1.6-4.fc32.aarch64 krb5-libs-1.18.2-3.fc33.aarch64 libcom_err-1.45.6-2.fc33.aarch64 libffi-3.1-25.fc33.aarch64 libgcc-10.1.1-1.fc33.aarch64 libselinux-3.0-5.fc33.aarch64 libstdc++-10.1.1-1.fc33.aarch64 libtasn1-4.16.0-1.fc32.aarch64 libxcrypt-4.4.16-3.fc33.aarch64 nspr-4.25.0-1.fc33.aarch64 nss-3.53.0-2.fc33.aarch64 nss-softokn-3.53.0-2.fc33.aarch64 nss-softokn-freebl-3.53.0-2.fc33.aarch64 nss-util-3.53.0-2.fc33.aarch64 opencryptoki-libs-3.14.0-2.fc33.aarch64 openldap-2.4.47-4.fc32.aarch64 openssl-libs-1.1.1g-9.fc33.aarch64 p11-kit-0.23.20-1.fc32.aarch64 p11-kit-trust-0.23.20-1.fc32.aarch64 pcre2-10.35-3.fc33.aarch64 softhsm-2.6.1-3.fc33.aarch64 sqlite-libs-3.32.2-1.fc33.aarch64 sssd-client-2.3.0-2.fc33.aarch64 zlib-1.2.11-21.fc32.aarch64                                                                 
Comment        :                                                                                                                                                                                                                               
Packages Altered:                                                                                                                                                                                                                              
    Install cyrus-sasl-debuginfo-2.1.27-5.fc33.aarch64         @rawhide-debuginfo                                                                                                                                                              
    Install cyrus-sasl-debugsource-2.1.27-5.fc33.aarch64       @rawhide-debuginfo                                                                                                                                                              
    Install cyrus-sasl-lib-debuginfo-2.1.27-5.fc33.aarch64     @rawhide-debuginfo                                                                                                                                                              
    Install e2fsprogs-debuginfo-1.45.6-2.fc33.aarch64          @rawhide-debuginfo                                                                                                                                                              
    Install e2fsprogs-debugsource-1.45.6-2.fc33.aarch64        @rawhide-debuginfo                                                                                                                                                              
    Install gcc-debuginfo-10.1.1-1.fc33.aarch64                @rawhide-debuginfo                                                                                                                                                              
    Install gcc-debugsource-10.1.1-1.fc33.aarch64              @rawhide-debuginfo                                                                                                                                                              
    Install glibc-debuginfo-2.31.9000-13.fc33.aarch64          @rawhide-debuginfo                                                                                                                                                              
    Install jss-debuginfo-4.6.4-1.fc33.aarch64                 @rawhide-debuginfo                                                                                                                                                              
    Install jss-debugsource-4.6.4-1.fc33.aarch64               @rawhide-debuginfo                                                                                                                                                              
    Install keyutils-debuginfo-1.6-4.fc32.aarch64              @rawhide-debuginfo                                                                                                                                                              
    Install keyutils-debugsource-1.6-4.fc32.aarch64            @rawhide-debuginfo                                                                                                                                                              
    Install keyutils-libs-debuginfo-1.6-4.fc32.aarch64         @rawhide-debuginfo                                                                                                                                                              
    Install krb5-debuginfo-1.18.2-3.fc33.aarch64               @rawhide-debuginfo                                                                                                                                                              
    Install krb5-debugsource-1.18.2-3.fc33.aarch64             @rawhide-debuginfo                                                                                                                                                              
    Install krb5-libs-debuginfo-1.18.2-3.fc33.aarch64          @rawhide-debuginfo                                                                                                                                                              
    Install libcom_err-debuginfo-1.45.6-2.fc33.aarch64         @rawhide-debuginfo                                                                                                                                                              
    Install libffi-debuginfo-3.1-25.fc33.aarch64               @rawhide-debuginfo                                                                                                                                                              
    Install libffi-debugsource-3.1-25.fc33.aarch64             @rawhide-debuginfo                                                                                                                                                              
    Install libgcc-debuginfo-10.1.1-1.fc33.aarch64             @rawhide-debuginfo                                                                                                                                                              
    Install libselinux-debuginfo-3.0-5.fc33.aarch64            @rawhide-debuginfo                                                                                                                                                              
    Install libselinux-debugsource-3.0-5.fc33.aarch64          @rawhide-debuginfo                                                                                                                                                              
    Install libstdc++-debuginfo-10.1.1-1.fc33.aarch64          @rawhide-debuginfo                                                                                                                                                              
    Install libtasn1-debuginfo-4.16.0-1.fc32.aarch64           @rawhide-debuginfo                                                                                                                                                              
    Install libtasn1-debugsource-4.16.0-1.fc32.aarch64         @rawhide-debuginfo                                                                                                                                                              
    Install libxcrypt-debuginfo-4.4.16-3.fc33.aarch64          @rawhide-debuginfo                                                                                                                                                              
    Install libxcrypt-debugsource-4.4.16-3.fc33.aarch64        @rawhide-debuginfo                                                                                                                                                              
    Install nspr-debuginfo-4.25.0-1.fc33.aarch64               @rawhide-debuginfo                                                                                                                                                              
    Install nspr-debugsource-4.25.0-1.fc33.aarch64             @rawhide-debuginfo                                                                                                                                                              
    Install nss-debuginfo-3.53.0-2.fc33.aarch64                @rawhide-debuginfo                                                                                                                                                              
    Install nss-debugsource-3.53.0-2.fc33.aarch64              @rawhide-debuginfo                                                                                                                                                              
    Install nss-softokn-debuginfo-3.53.0-2.fc33.aarch64        @rawhide-debuginfo                                                                                                                                                              
    Install nss-softokn-freebl-debuginfo-3.53.0-2.fc33.aarch64 @rawhide-debuginfo                                                                                                                                                              
    Install nss-util-debuginfo-3.53.0-2.fc33.aarch64           @rawhide-debuginfo                                                                                                                                                              
    Install opencryptoki-debuginfo-3.14.0-2.fc33.aarch64       @rawhide-debuginfo                                                                                                                                                              
    Install opencryptoki-debugsource-3.14.0-2.fc33.aarch64     @rawhide-debuginfo                                                                                                                                                              
    Install opencryptoki-libs-debuginfo-3.14.0-2.fc33.aarch64  @rawhide-debuginfo                                                                                                                                                              
    Install openldap-debuginfo-2.4.47-4.fc32.aarch64           @rawhide-debuginfo                                                                                                                                                              
    Install openldap-debugsource-2.4.47-4.fc32.aarch64         @rawhide-debuginfo                                                                                                                                                              
    Install openssl-debuginfo-1:1.1.1g-9.fc33.aarch64          @rawhide-debuginfo
    Install openssl-debugsource-1:1.1.1g-9.fc33.aarch64        @rawhide-debuginfo                                                                                                                                                              
    Install openssl-libs-debuginfo-1:1.1.1g-9.fc33.aarch64     @rawhide-debuginfo                                                                                                                                                              
    Install p11-kit-debuginfo-0.23.20-1.fc32.aarch64           @rawhide-debuginfo                                                                                                                                                              
    Install p11-kit-debugsource-0.23.20-1.fc32.aarch64         @rawhide-debuginfo                                                                                                                                                              
    Install p11-kit-trust-debuginfo-0.23.20-1.fc32.aarch64     @rawhide-debuginfo                                                                                                                                                              
    Install pcre2-debuginfo-10.35-3.fc33.aarch64               @rawhide-debuginfo                                                                                                                                                              
    Install pcre2-debugsource-10.35-3.fc33.aarch64             @rawhide-debuginfo                                                                                                                                                              
    Install softhsm-debuginfo-2.6.1-3.fc33.aarch64             @rawhide-debuginfo                                                                                                                                                              
    Install softhsm-debugsource-2.6.1-3.fc33.aarch64           @rawhide-debuginfo                                                                                                                                                              
    Install sqlite-debuginfo-3.32.2-1.fc33.aarch64             @rawhide-debuginfo                                                                                                                                                              
    Install sqlite-debugsource-3.32.2-1.fc33.aarch64           @rawhide-debuginfo                                                                                                                                                              
    Install sqlite-libs-debuginfo-3.32.2-1.fc33.aarch64        @rawhide-debuginfo                                                                                                                                                              
    Install sssd-client-debuginfo-2.3.0-2.fc33.aarch64         @rawhide-debuginfo                                                                                                                                                              
    Install sssd-debuginfo-2.3.0-2.fc33.aarch64                @rawhide-debuginfo                                                                                                                                                              
    Install sssd-debugsource-2.3.0-2.fc33.aarch64              @rawhide-debuginfo                                                                                                                                                              
    Install zlib-debuginfo-1.2.11-21.fc32.aarch64              @rawhide-debuginfo                                                                                                                                                              
    Install zlib-debugsource-1.2.11-21.fc32.aarch64            @rawhide-debuginfo

Comment 6 David Sastre Medina 2020-06-10 07:41:13 UTC
Created attachment 1696450 [details]
Backtrace

Comment 7 Alex Scheel 2020-07-01 13:39:46 UTC
I've opened this upstream:

https://github.com/opencryptoki/opencryptoki/pull/305


There's a branch here that seems to fix it:

https://src.fedoraproject.org/fork/cipherboy/rpms/opencryptoki/tree/fix-error-c-initialize


However, I'm unable to open a PR due to infrastructure issues:

https://pagure.io/fedora-infrastructure/issue/9103


This has fixed the issue for me, AFAICT.



Dan, any chance you could pull my patch into Rawhide once merged upstream? Thanks!

Comment 8 Than Ngo 2020-07-01 17:36:10 UTC
it's fixed in in opencryptoki-3.14.0-3.fc33.

Thank you so much!

Comment 9 Dan Horák 2020-07-01 17:38:19 UTC
I could, but Than has been faster :-) And great job, Alex.


Note You need to log in before you can comment on or make changes to this bug.