Fedora Account System
Red Hat Associate
Red Hat Customer
Description of problem: Segfault when system perform logrotate. Generate lots of core dump files and apache hangs. It seems the apache module mod_lookup_identity is the only module that would use libdbus. Version-Release number of selected component (if applicable): httpd-2.4.34-3.fc28.x86_64 mod_lookup_identity-1.0.0-4.fc27.x86_64 dbus-libs-1.12.8-1.fc28.i686 freeipa-server-4.6.90.pre2-3.fc28.x86_64 How reproducible: Having the problem just now Steps to Reproduce: Happened once when the system perform logrotate I am using mpm event, would change back to mpm prefork/worker to see if it still happen. Additional info: Apache error log: [Tue Aug 07 00:01:01.733919 2018] [lbmethod_heartbeat:notice] [pid 25705:tid 140235695196416] AH02282: No slotmem from mod_heartmonitor [Tue Aug 07 00:01:01.736604 2018] [mpm_event:notice] [pid 25705:tid 140235695196416] AH00489: Apache/2.4.34 (Fedora) OpenSSL/1.1.0h-fips mod_wsgi/4.5.20 Python/3.6 mod_auth_gssapi/1.6.0 configured -- resuming no rmal operations [Tue Aug 07 00:01:01.736616 2018] [core:notice] [pid 25705:tid 140235695196416] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND' [Tue Aug 07 00:01:02.740012 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16896 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:02.740061 2018] [cgid:error] [pid 25705:tid 140235695196416] AH01239: cgid daemon process died, restarting [Tue Aug 07 00:01:02.740580 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16897 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:02.741151 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16898 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:02.741742 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16899 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:02.742297 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16900 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:02.742850 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16901 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:02.742860 2018] [core:error] [pid 25705:tid 140235695196416] AH00546: no record of generation 0 of exiting child 16901 [Tue Aug 07 00:01:02.742934 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16902 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:02.742942 2018] [core:error] [pid 25705:tid 140235695196416] AH00546: no record of generation 0 of exiting child 16902 [Tue Aug 07 00:01:02.742950 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16903 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:02.742954 2018] [core:error] [pid 25705:tid 140235695196416] AH00546: no record of generation 0 of exiting child 16903 [Tue Aug 07 00:01:03.744052 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16913 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:03.744081 2018] [core:error] [pid 25705:tid 140235695196416] AH00546: no record of generation 0 of exiting child 16913 [Tue Aug 07 00:01:03.744087 2018] [core:notice] [pid 25705:tid 140235695196416] AH00051: child pid 16914 exit signal Segmentation fault (11), possible coredump in /etc/httpd [Tue Aug 07 00:01:03.744109 2018] [cgid:error] [pid 25705:tid 140235695196416] AH01239: cgid daemon process died, restarting Kernel: Aug 7 00:01:01 server1 kernel: [35331.841531] httpd[16896]: segfault at 7f8b1798d6c0 ip 00007f8b1798d6c0 sp 00007ffe71b66198 error 14 in libdbus-1.so.3.19.7[7f8b183d4000+50000] Aug 7 00:01:01 server1 kernel: [35331.842075] httpd[16897]: segfault at 7f8b1798d6c0 ip 00007f8b1798d6c0 sp 00007ffe71b65db8 error 14 in libdbus-1.so.3.19.7[7f8b183d4000+50000] Aug 7 00:01:01 server1 kernel: [35331.842543] httpd[16898]: segfault at 7f8b1798d6c0 ip 00007f8b1798d6c0 sp 00007ffe71b65db8 error 14 in libdbus-1.so.3.19.7[7f8b183d4000+50000] Aug 7 00:01:01 server1 kernel: [35331.843231] httpd[16899]: segfault at 7f8b1798d6c0 ip 00007f8b1798d6c0 sp 00007ffe71b65db8 error 14 in libdbus-1.so.3.19.7[7f8b183d4000+50000] Aug 7 00:01:01 server1 kernel: [35331.845063] httpd[16900]: segfault at 7f8b1798d6c0 ip 00007f8b1798d6c0 sp 00007ffe71b65db8 error 14 in libdbus-1.so.3.19.7[7f8b183d4000+50000] (gdb) where #0 0x00007f8b1798d6c0 in ?? () #1 0x00007f8b293cfbce in __libc_fork () at ../sysdeps/nptl/fork.c:204 #2 0x00007f8b29b14a68 in apr_proc_fork (proc=proc@entry=0x55e82cea3088, pool=pool@entry=0x55e82ce73a78) at threadproc/unix/proc.c:225 #3 0x00007f8b1ac11849 in wsgi_start_process (p=0x55e82ce73a78, daemon=0x55e82cea3078) at src/server/mod_wsgi.c:9668 #4 0x00007f8b1ac13e88 in wsgi_start_daemons (p=p@entry=0x55e82ce73a78) at src/server/mod_wsgi.c:10427 #5 0x00007f8b1ac147fb in wsgi_hook_init (pconf=0x55e82ce73a78, ptemp=<optimized out>, plog=<optimized out>, s=0x55e82ce9cd20) at src/server/mod_wsgi.c:13076 #6 0x000055e82c0e2573 in ap_run_post_config (pconf=0x55e82ce73a78, plog=0x55e82cea0c98, ptemp=0x55e82cea6d18, s=0x55e82ce9cd20) at config.c:103 #7 0x000055e82c100c63 in ?? () #8 0x000055e82ce71b58 in ?? () #9 0x00007ffe71b66330 in ?? () #10 0x000055e82c100c63 in ?? () #11 0x000055e82c323098 in ap_prelinked_modules () #12 0x00007ffe71b66323 in ?? () #13 0x000055e82ce73a78 in ?? () #14 0x000055e82c0bd9cf in main (argc=<optimized out>, argv=<optimized out>) at main.c:807 (gdb) where #0 0x00007f8b1798d6c0 in ?? () #1 0x00007f8b293cfbce in __libc_fork () at ../sysdeps/nptl/fork.c:204 #2 0x00007f8b1e6090af in make_child (s=0x55e82ce9cd20, slot=slot@entry=10, bucket=bucket@entry=0) at event.c:2629 #3 0x00007f8b1e609b33 in perform_idle_server_maintenance (num_buckets=<optimized out>, child_bucket=<optimized out>) at event.c:2848 #4 server_main_loop (num_buckets=1, remaining_children_to_start=0) at event.c:2976 #5 event_run (_pconf=<optimized out>, plog=<optimized out>, s=<optimized out>) at event.c:3053 #6 0x000055e82c0c530e in ap_run_mpm (pconf=0x55e82ce73a78, plog=0x55e82cea0c98, s=0x55e82ce9cd20) at mpm_common.c:94 #7 0x000055e82ce71b58 in ?? () #8 0x00007ffe71b66330 in ?? () #9 0x000055e82c100c63 in ?? () #10 0x0000000000000000 in ?? ()
*** This bug has been marked as a duplicate of bug 1599075 ***
Hi Joe, I know this bug is closed but I got new error messages. I don't want to complicate bug 1599075 so I post it in here. The apache config is the same. I have changed from mpm event to mpm worker. Apache is not responsive but there is no core dump. [Wed Aug 08 00:05:56.585300 2018] [mpm_worker:notice] [pid 8594:tid 139896893307136] AH00292: Apache/2.4.34 (Fedora) OpenSSL/1.1.0h-fips mod _wsgi/4.5.20 Python/3.6 mod_auth_gssapi/1.6.0 configured -- resuming normal operations [Wed Aug 08 00:05:56.585318 2018] [core:notice] [pid 8594:tid 139896893307136] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND' [Wed Aug 08 00:05:57.588342 2018] [core:notice] [pid 8594:tid 139896893307136] AH00052: child pid 9227 exit signal Segmentation fault (11) [Wed Aug 08 00:05:57.588373 2018] [core:error] [pid 8594:tid 139896893307136] AH00546: no record of generation 1 of exiting child 9227 [Wed Aug 08 00:05:57.588441 2018] [core:notice] [pid 8594:tid 139896893307136] AH00052: child pid 9228 exit signal Segmentation fault (11) [Wed Aug 08 00:05:57.588447 2018] [core:error] [pid 8594:tid 139896893307136] AH00546: no record of generation 1 of exiting child 9228 [Wed Aug 08 00:05:57.588452 2018] [core:notice] [pid 8594:tid 139896893307136] AH00052: child pid 9230 exit signal Segmentation fault (11) [Wed Aug 08 00:05:57.588455 2018] [core:error] [pid 8594:tid 139896893307136] AH00546: no record of generation 1 of exiting child 9230 [Wed Aug 08 00:05:58.589432 2018] [core:notice] [pid 8594:tid 139896893307136] AH00052: child pid 9449 exit signal Segmentation fault (11) [Wed Aug 08 00:05:58.589469 2018] [core:error] [pid 8594:tid 139896893307136] AH00546: no record of generation 0 of exiting child 9449 [Wed Aug 08 00:05:58.892408 2018] [wsgi:error] [pid 9225:tid 139896893307136] ipa: INFO: *** PROCESS START *** [Wed Aug 08 00:05:58.921946 2018] [wsgi:error] [pid 9226:tid 139896893307136] ipa: INFO: *** PROCESS START *** [Wed Aug 08 00:05:59.590418 2018] [core:notice] [pid 8594:tid 139896893307136] AH00052: child pid 9469 exit signal Segmentation fault (11) [Wed Aug 08 00:05:59.590455 2018] [core:error] [pid 8594:tid 139896893307136] AH00546: no record of generation 1 of exiting child 9469 [Wed Aug 08 00:06:00.592277 2018] [core:notice] [pid 8594:tid 139896893307136] AH00052: child pid 9493 exit signal Segmentation fault (11) [Wed Aug 08 00:06:00.592309 2018] [core:error] [pid 8594:tid 139896893307136] AH00546: no record of generation 1 of exiting child 9493 Aug 8 00:10:11 server1 kernel: [ 4639.983924] httpd[20498]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:10:11 server1 kernel: [ 4639.983924] httpd[20498]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:17:52 server1 kernel: [ 5101.638586] httpd[6013]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:17:52 server1 kernel: [ 5101.638586] httpd[6013]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:24:11 server1 kernel: [ 5480.770503] httpd[22570]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:24:11 server1 kernel: [ 5480.770503] httpd[22570]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:30:49 server1 kernel: [ 5878.040740] httpd[7513]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:30:49 server1 kernel: [ 5878.040740] httpd[7513]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:34:20 server1 kernel: [ 6089.244819] httpd[16160]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000] Aug 8 00:34:20 server1 kernel: [ 6089.244819] httpd[16160]: segfault at 8 ip 00007f3c4785ff74 sp 00007ffcc81a2408 error 4 in libapr-1.so.0.6.3[7f3c47842000+36000]