Bug 708032

Summary: [abrt] systemd-26-1.fc15: crash: Process /bin/systemd was killed by signal 11 (SIGSEGV)
Product: [Fedora] Fedora Reporter: Michael Ekstrand <michael>
Component: systemdAssignee: systemd-maint
Status: CLOSED CANTFIX QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 15CC: harald, johannbg, johannbg, lpoetter, metherid, mschmidt, notting, plautrba
Target Milestone: ---   
Target Release: ---   
Hardware: i686   
OS: Unspecified   
Whiteboard: abrt_hash:ba2644fa95e49ca5f73dca608ff14db5022eb652
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-01-26 09:49:13 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Michael Ekstrand 2011-05-26 15:26:31 UTC
abrt version: 2.0.1
architecture:   i686
cmdline:        /sbin/init
component:      systemd
crash_function: crash
executable:     /bin/systemd
kernel:         2.6.38.6-27.fc15.i686.PAE
os_release:     Fedora release 15 (Lovelock)
package:        systemd-26-1.fc15
rating:         4
reason:         Process /bin/systemd was killed by signal 11 (SIGSEGV)
time:           Thu May 26 09:49:32 2011
uid:            0
username:       root

backtrace:
:Missing separate debuginfo for 
:Try: yum --disablerepo='*' --enablerepo='*-debuginfo' install /usr/lib/debug/.build-id/2c/a8544b0ff9269420c23a0ac22da52b7894148b
:[New LWP 3118]
:[Thread debugging using libthread_db enabled]
:Core was generated by `/sbin/init'.
:Program terminated with signal 11, Segmentation fault.
:#0  0x00683424 in __kernel_vsyscall ()
:
:Thread 1 (Thread 0xb773b720 (LWP 3118)):
:#0  0x00683424 in __kernel_vsyscall ()
:No symbol table info available.
:#1  0x41acf9de in raise (sig=11) at ../nptl/sysdeps/unix/sysv/linux/pt-raise.c:42
:        resultvar = <optimized out>
:        resultvar = <optimized out>
:        pid = <optimized out>
:#2  0x08050f04 in crash (sig=11) at src/main.c:121
:        rl = {rlim_cur = 18446744073709551615, rlim_max = 18446744073709551615}
:        sa = {__sigaction_handler = {sa_handler = 0, sa_sigaction = 0}, sa_mask = {__val = {0 <repeats 32 times>}}, sa_flags = 0, sa_restorer = 0}
:        pid = 0
:        __func__ = "crash"
:        __PRETTY_FUNCTION__ = "crash"
:#3  <signal handler called>
:No symbol table info available.
:#4  0x0804ca7c in stpcpy@plt ()
:No symbol table info available.
:#5  0x08084592 in exec_command_line (argv=0x8f51b88) at /usr/include/bits/string3.h:112
:        k = <optimized out>
:        n = 0x8ef3bf0 "8\364\250A\320\t\365\b"
:        p = 0x8ef3bf0 "8\364\250A\320\t\365\b"
:        a = 0x8f51b88
:        first = false
:        __PRETTY_FUNCTION__ = "exec_command_line"
:#6  0x0808475e in exec_spawn (command=0x8ec5230, argv=0x8f51b88, context=0x8ddcf58, fds=0x0, n_fds=0, environment=0x8f4c1f8, apply_permissions=true, apply_chroot=true, apply_tty_stdin=true, confirm_spawn=false, cgroup_bondings=0x8ec4ce8, ret=0xbfd355dc) at src/execute.c:1014
:        pid = <optimized out>
:        r = <optimized out>
:        line = <optimized out>
:        socket_fd = -1
:        files_env = 0x0
:        __PRETTY_FUNCTION__ = "exec_spawn"
:        __func__ = "exec_spawn"
:#7  0x08069bd2 in service_spawn (s=<optimized out>, c=<optimized out>, timeout=false, pass_fds=true, apply_permissions=true, apply_chroot=true, apply_tty_stdin=true, set_notify_socket=false, _pid=0xbfd3563c) at src/service.c:1703
:        pid = <optimized out>
:        r = <optimized out>
:        fds = 0x0
:        fdsbuf = 0x0
:        n_fds = 0
:        n_env = <optimized out>
:        argv = 0x8f51b88
:        final_env = 0x8f4c1f8
:        our_env = 0x8efa890
:        __PRETTY_FUNCTION__ = "service_spawn"
:#8  0x0806c21f in service_enter_start (s=0x8ddce10) at src/service.c:2046
:        pid = <optimized out>
:        r = <optimized out>
:        c = <optimized out>
:        __PRETTY_FUNCTION__ = "service_enter_start"
:        __func__ = "service_enter_start"
:#9  0x0806c717 in service_enter_start_pre (s=0x8ddce10) at src/service.c:2118
:        r = <optimized out>
:#10 service_start (u=0x8ddce10) at src/service.c:2303
:        s = 0x8ddce10
:        __PRETTY_FUNCTION__ = "service_start"
:        __func__ = "service_start"
:#11 0x080c0705 in unit_start (u=0x8ddce10) at src/unit.c:905
:        state = <optimized out>
:        following = <optimized out>
:        __PRETTY_FUNCTION__ = "unit_start"
:        __func__ = "unit_start"
:#12 0x080c35f2 in job_run_and_invalidate (j=0x8f516e0) at src/job.c:430
:        r = <optimized out>
:        id = 665
:        m = 0x8cd1af0
:        __PRETTY_FUNCTION__ = "job_run_and_invalidate"
:#13 0x08056845 in manager_dispatch_run_queue (m=0x8cd1af0) at src/manager.c:1872
:        j = <optimized out>
:        n = <optimized out>
:        __PRETTY_FUNCTION__ = "manager_dispatch_run_queue"
:#14 0x08058437 in manager_loop (m=0x8cd1af0) at src/manager.c:2381
:        event = {events = 1, data = {ptr = 0x8cd1b58, fd = 147659608, u32 = 147659608, u64 = 147659608}}
:        n = <optimized out>
:        r = <optimized out>
:        rl = {interval = 1000000, begin = 1507134646, burst = 50000, num = 22}
:        __PRETTY_FUNCTION__ = "manager_loop"
:        __func__ = "manager_loop"
:#15 0x0804e98c in main (argc=1, argv=0xbfd35b64) at src/main.c:1277
:        m = 0x8cd1af0
:        r = <optimized out>
:        retval = 1
:        fds = 0x0
:        reexecute = false
:        shutdown_verb = 0x0
:        initrd_timestamp = {realtime = 1306397577012145, monotonic = 3296592}
:        systemd = "systemd"
:        __func__ = "main"
:        __PRETTY_FUNCTION__ = "main"
:From        To          Syms Read   Shared Object Library
:0x41c9d490  0x41caed9c  Yes         /lib/libselinux.so.1
:0x426286a0  0x42657cfc  Yes         /lib/libdbus-1.so.3.5.4
:0x41ac5630  0x41ad157c  Yes         /lib/libpthread-2.13.90.so
:0x435853b0  0x4358eacc  Yes         /lib/libudev.so.0.11.1
:0x4367ff10  0x43683eec  Yes         /lib/libwrap.so.0.7.6
:0x42493b40  0x4249b4dc  Yes         /lib/libpam.so.0.83.0
:0x425d7b30  0x425dd54c  Yes         /lib/libaudit.so.1.0.0
:0x41cbad00  0x41cbc87c  Yes         /lib/libcap.so.2.17
:0x41ae68c0  0x41aea6fc  Yes         /lib/librt-2.13.90.so
:0x4191ace0  0x41a38324  Yes         /lib/libc-2.13.90.so
:0x418e1850  0x418f97ff  Yes         /lib/ld-2.13.90.so
:0x41adea60  0x41adfa8c  Yes         /lib/libdl-2.13.90.so
:0x430e4f30  0x430fbc5c  Yes         /lib/libgcc_s-4.6.0-20110509.so.1
:0x439100f0  0x4391e7bc  Yes         /lib/libnsl-2.13.90.so
:0x41fb6de0  0x41fb93cc  Yes         /lib/libattr.so.1.1.0
:0x0086da40  0x00874d8c  Yes         /lib/libnss_files-2.13.90.so
:$1 = 0x0
:No symbol "__glib_assert_msg" in current context.
:eax            0x0	0
:ecx            0xc2e	3118
:edx            0xb	11
:ebx            0xc2e	3118
:esp            0xbfd34b84	0xbfd34b84
:ebp            0xb	0xb
:esi            0x0	0
:edi            0x41ad8ff4	1101893620
:eip            0x683424	0x683424 <__kernel_vsyscall+16>
:eflags         0x206	[ PF IF ]
:cs             0x73	115
:ss             0x7b	123
:ds             0x7b	123
:es             0x7b	123
:fs             0x0	0
:gs             0x33	51
:Dump of assembler code for function __kernel_vsyscall:
:   0x00683414 <+0>:	push   %ecx
:   0x00683415 <+1>:	push   %edx
:   0x00683416 <+2>:	push   %ebp
:   0x00683417 <+3>:	mov    %esp,%ebp
:   0x00683419 <+5>:	sysenter 
:   0x0068341b <+7>:	nop
:   0x0068341c <+8>:	nop
:   0x0068341d <+9>:	nop
:   0x0068341e <+10>:	nop
:   0x0068341f <+11>:	nop
:   0x00683420 <+12>:	nop
:   0x00683421 <+13>:	nop
:   0x00683422 <+14>:	jmp    0x683417 <__kernel_vsyscall+3>
:=> 0x00683424 <+16>:	pop    %ebp
:   0x00683425 <+17>:	pop    %edx
:   0x00683426 <+18>:	pop    %ecx
:   0x00683427 <+19>:	ret    
:End of assembler dump.

comment:
:systemd crashed upon resuming from hibernate.
:
:Earlier in the day on a different resume, I experienced a systemd crash and subsequent gnome-screensaver-dialog crashes, all in libdbus-1.so.3.5.4, with the following log entries:
:
:May 26 08:08:52 knine kernel: [34095.220988] systemctl[9732]: segfault at 4262fa03 ip 42651fe9 sp bfe43098 error 7 in libdbus-1.so.3.5.4[42623000+47000]
:May 26 08:08:52 knine kernel: [34095.221121] systemd[1]: segfault at 0 ip 4262e381 sp bfec75c0 error 6 in libdbus-1.so.3.5.4[42623000+47000]
:May 26 08:09:16 knine kernel: [34119.133615] gnome-screensav[9820]: segfault at 4262fa03 ip 42651fe9 sp b762ce98 error 7 in libdbus-1.so.3.5.4[42623000+47000]
:May 26 08:11:11 knine kernel: [34234.030836] gnome-screensav[10083]: segfault at 4262fa03 ip 42651fe9 sp b7455e98 error 7 in libdbus-1.so.3.5.4[42623000+47000]
:May 26 08:11:11 knine abrt[10084]: not dumping repeating crash in '/usr/libexec/gnome-screensaver-dialog'
:May 26 08:11:11 knine kernel: [34234.299774] gnome-screensav[10092]: segfault at 4262fa03 ip 42651fe9 sp b7615e98 error 7 in libdbus-1.so.3.5.4[42623000+47000]
:May 26 08:11:11 knine abrt[10093]: not dumping repeating crash in '/usr/libexec/gnome-screensaver-dialog'
:May 26 08:11:11 knine kernel: [34234.650953] gnome-screensav[10095]: segfault at 4262fa03 ip 42651fe9 sp b7631e98 error 7 in libdbus-1.so.3.5.4[42623000+47000]
:May 26 08:11:11 knine abrt[10096]: not dumping repeating crash in '/usr/libexec/gnome-screensaver-dialog'
:
:Package version numbers:
:dbus-libs: 1.4.6-4.fc15.i686
:systemd: 26-1.fc15.i686
:gnome-screensaver: 3.0.0-1.fc15.i686

dsos:
:/lib/libcap.so.2.17 libcap-2.17-2.fc15.i686 (Fedora Project) 1305680344
:/lib/libwrap.so.0.7.6 tcp_wrappers-libs-7.6-60.fc15.i686 (Fedora Project) 1305680207
:/lib/libgcc_s-4.6.0-20110509.so.1 libgcc-4.6.0-7.fc15.i686 (Fedora Project) 1305836422
:/lib/ld-2.13.90.so glibc-2.13.90-9.i686 (Fedora Project) 1305757262
:/lib/libnss_files-2.13.90.so glibc-2.13.90-9.i686 (Fedora Project) 1305757262
:/bin/systemd systemd-26-1.fc15.i686 (Fedora Project) 1305684726
:/lib/libc-2.13.90.so glibc-2.13.90-9.i686 (Fedora Project) 1305757262
:/lib/libattr.so.1.1.0 libattr-2.4.44-7.fc15.i686 (Fedora Project) 1305680343
:/lib/libnsl-2.13.90.so glibc-2.13.90-9.i686 (Fedora Project) 1305757262
:/lib/libpthread-2.13.90.so glibc-2.13.90-9.i686 (Fedora Project) 1305757262
:/lib/libselinux.so.1 libselinux-2.0.99-4.fc15.i686 (Fedora Project) 1305680228
:/lib/libudev.so.0.11.1 libudev-167-4.fc15.i686 (Fedora Project) 1305680205
:/lib/librt-2.13.90.so glibc-2.13.90-9.i686 (Fedora Project) 1305757262
:/lib/libdbus-1.so.3.5.4 dbus-libs-1:1.4.6-4.fc15.i686 (Fedora Project) 1305680183
:/lib/libpam.so.0.83.0 pam-1.1.3-8.fc15.i686 (Fedora Project) 1305680949
:/lib/libaudit.so.1.0.0 audit-libs-2.1.1-1.fc15.i686 (Fedora Project) 1305680193
:/lib/libdl-2.13.90.so glibc-2.13.90-9.i686 (Fedora Project) 1305757262

environ:
:RD_ROOTFS_FSCK=0
:HOME=/
:TERM=linux
:PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
:'RD_TIMESTAMP=1306397577012145 3296592'

event_log:
:2011-05-26-10:12:31> Analyzing crash data
:2011-05-26-10:12:43  Analyzing crash data
:2011-05-26-10:12:54  Analyzing crash data
:2011-05-26-10:13:07  Analyzing crash data
:2011-05-26-10:13:18  Analyzing crash data
:2011-05-26-10:13:30  Analyzing crash data
:2011-05-26-10:13:42  Analyzing crash data
:2011-05-26-10:13:53  Initializing virtual root
:2011-05-26-10:14:05  Initializing virtual root
:2011-05-26-10:14:18  Initializing virtual root
:2011-05-26-10:14:30  Initializing virtual root
:2011-05-26-10:14:40  Initializing virtual root
:2011-05-26-10:14:57  Initializing virtual root
:2011-05-26-10:15:09  Initializing virtual root
:2011-05-26-10:15:21  Initializing virtual root
:2011-05-26-10:15:38  Initializing virtual root
:2011-05-26-10:15:48  Initializing virtual root
:2011-05-26-10:16:00  Initializing virtual root
:2011-05-26-10:16:11  Initializing virtual root
:2011-05-26-10:16:21  Initializing virtual root
:2011-05-26-10:16:32  Initializing virtual root
:2011-05-26-10:16:43  Initializing virtual root
:2011-05-26-10:16:55  Initializing virtual root
:2011-05-26-10:17:05  Initializing virtual root
:2011-05-26-10:17:16  Initializing virtual root
:2011-05-26-10:17:27  Initializing virtual root
:2011-05-26-10:17:38  Initializing virtual root
:2011-05-26-10:17:48  Initializing virtual root
:2011-05-26-10:17:59  Initializing virtual root
:2011-05-26-10:18:10  Initializing virtual root
:2011-05-26-10:18:21  Initializing virtual root
:2011-05-26-10:18:32  Initializing virtual root
:2011-05-26-10:18:43  Initializing virtual root
:2011-05-26-10:18:54  Initializing virtual root
:2011-05-26-10:19:05  Initializing virtual root
:2011-05-26-10:19:15  Initializing virtual root
:2011-05-26-10:19:27  Initializing virtual root
:2011-05-26-10:19:38  Initializing virtual root
:2011-05-26-10:19:48  Initializing virtual root
:2011-05-26-10:20:04  Cleaning up virtual root
:2011-05-26-10:20:15  Retrace job finished successfully
:2011-05-26-10:21:15> Empty login or password, please check your configuration
:2011-05-26-10:21:15* (exited with 1)

maps:
:00683000-00684000 r-xp 00000000 00:00 0          [vdso]
:0086c000-00877000 r-xp 00000000 fd:02 131838     /lib/libnss_files-2.13.90.so
:00877000-00878000 r--p 0000a000 fd:02 131838     /lib/libnss_files-2.13.90.so
:00878000-00879000 rw-p 0000b000 fd:02 131838     /lib/libnss_files-2.13.90.so
:08048000-08108000 r-xp 00000000 fd:02 261211     /bin/systemd
:08108000-0810d000 rw-p 000bf000 fd:02 261211     /bin/systemd
:08439000-08f64000 rw-p 00000000 00:00 0          [heap]
:418e1000-41900000 r-xp 00000000 fd:02 131837     /lib/ld-2.13.90.so
:41900000-41901000 r--p 0001f000 fd:02 131837     /lib/ld-2.13.90.so
:41901000-41902000 rw-p 00020000 fd:02 131837     /lib/ld-2.13.90.so
:41904000-41a8c000 r-xp 00000000 fd:02 131839     /lib/libc-2.13.90.so
:41a8c000-41a8e000 r--p 00188000 fd:02 131839     /lib/libc-2.13.90.so
:41a8e000-41a8f000 rw-p 0018a000 fd:02 131839     /lib/libc-2.13.90.so
:41a8f000-41a92000 rw-p 00000000 00:00 0 
:41ac1000-41ad8000 r-xp 00000000 fd:02 135255     /lib/libpthread-2.13.90.so
:41ad8000-41ad9000 r--p 00016000 fd:02 135255     /lib/libpthread-2.13.90.so
:41ad9000-41ada000 rw-p 00017000 fd:02 135255     /lib/libpthread-2.13.90.so
:41ada000-41adc000 rw-p 00000000 00:00 0 
:41ade000-41ae1000 r-xp 00000000 fd:02 131879     /lib/libdl-2.13.90.so
:41ae1000-41ae2000 r--p 00002000 fd:02 131879     /lib/libdl-2.13.90.so
:41ae2000-41ae3000 rw-p 00003000 fd:02 131879     /lib/libdl-2.13.90.so
:41ae5000-41aec000 r-xp 00000000 fd:02 136988     /lib/librt-2.13.90.so
:41aec000-41aed000 r--p 00006000 fd:02 136988     /lib/librt-2.13.90.so
:41aed000-41aee000 rw-p 00007000 fd:02 136988     /lib/librt-2.13.90.so
:41c99000-41cb6000 r-xp 00000000 fd:02 152845     /lib/libselinux.so.1
:41cb6000-41cb7000 r--p 0001c000 fd:02 152845     /lib/libselinux.so.1
:41cb7000-41cb8000 rw-p 0001d000 fd:02 152845     /lib/libselinux.so.1
:41cba000-41cbe000 r-xp 00000000 fd:02 152865     /lib/libcap.so.2.17
:41cbe000-41cbf000 rw-p 00003000 fd:02 152865     /lib/libcap.so.2.17
:41fb6000-41fba000 r-xp 00000000 fd:02 152864     /lib/libattr.so.1.1.0
:41fba000-41fbb000 rw-p 00003000 fd:02 152864     /lib/libattr.so.1.1.0
:42492000-4249f000 r-xp 00000000 fd:02 152881     /lib/libpam.so.0.83.0
:4249f000-424a0000 rw-p 0000c000 fd:02 152881     /lib/libpam.so.0.83.0
:425d6000-425ec000 r-xp 00000000 fd:02 152880     /lib/libaudit.so.1.0.0
:425ec000-425ed000 r--p 00015000 fd:02 152880     /lib/libaudit.so.1.0.0
:425ed000-425ee000 rw-p 00016000 fd:02 152880     /lib/libaudit.so.1.0.0
:42623000-4266a000 r-xp 00000000 fd:02 152868     /lib/libdbus-1.so.3.5.4
:4266a000-4266b000 r--p 00047000 fd:02 152868     /lib/libdbus-1.so.3.5.4
:4266b000-4266c000 rw-p 00048000 fd:02 152868     /lib/libdbus-1.so.3.5.4
:430e3000-430ff000 r-xp 00000000 fd:02 174614     /lib/libgcc_s-4.6.0-20110509.so.1
:430ff000-43100000 rw-p 0001b000 fd:02 174614     /lib/libgcc_s-4.6.0-20110509.so.1
:43583000-43592000 r-xp 00000000 fd:02 152871     /lib/libudev.so.0.11.1
:43592000-43593000 r--p 0000e000 fd:02 152871     /lib/libudev.so.0.11.1
:43593000-43594000 rw-p 0000f000 fd:02 152871     /lib/libudev.so.0.11.1
:4367e000-43686000 r-xp 00000000 fd:02 152320     /lib/libwrap.so.0.7.6
:43686000-43687000 rw-p 00008000 fd:02 152320     /lib/libwrap.so.0.7.6
:4390d000-43924000 r-xp 00000000 fd:02 152870     /lib/libnsl-2.13.90.so
:43924000-43925000 r--p 00016000 fd:02 152870     /lib/libnsl-2.13.90.so
:43925000-43926000 rw-p 00017000 fd:02 152870     /lib/libnsl-2.13.90.so
:43926000-43928000 rw-p 00000000 00:00 0 
:b76ab000-b76f3000 rw-p 00000000 00:00 0 
:b773b000-b773f000 rw-p 00000000 00:00 0 
:b7758000-b775b000 rw-p 00000000 00:00 0 
:bfd16000-bfd37000 rw-p 00000000 00:00 0          [stack]

Comment 1 Fedora Admin XMLRPC Client 2011-10-20 16:27:37 UTC
This package has changed ownership in the Fedora Package Database.  Reassigning to the new owner of this component.

Comment 2 Jóhann B. Guðmundsson 2012-01-25 14:08:46 UTC
Is this still an issue?

Comment 3 Michael Ekstrand 2012-01-25 18:25:01 UTC
I haven't been using hibernate in F16 (due to its seeming removal from the UI). I can dig it up and try.

Comment 4 Michal Schmidt 2012-01-26 09:49:13 UTC
It's almost certainly a result memory corruption caused by hibernation, i.e. a kernel bug.
I'm closing this BZ, instead of reassigning it to kernel, because the kernel developers aren't likely to find the original report with the old kernel version very useful. And there's been some discussion about disabling hibernation in the kernel altogether, because noone seems to be able to debug the several reports about the resulting corruption.

Comment 5 Michael Ekstrand 2012-01-26 17:18:15 UTC
Closure for that reason is understandable and acceptable. When I tried to hibernate last night to check for recurrence of the bug, the hibernate never completed (it hung at a text screen, had to do a hard shutdown).

I hope that a way is found to enable hibernate to work - it is useful to be able suspend work while enjoying the security of full-disk encryption. I was somewhat disappointed to find hibernate removed almost entirely from the F16 Gnome UI, at least without alternate-status-menu installed.