Bug 1346798

Summary: [abrt] sssd-common: talloc_abort(): sssd killed by SIGABRT
Product: [Fedora] Fedora Reporter: Pierre Ossman <ossman>
Component: sssdAssignee: Jakub Hrozek <jhrozek>
Status: CLOSED ERRATA QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 23CC: abokovoy, jhrozek, lslebodn, ossman, pbrezina, preichl, rharwood, sbose, ssorce
Target Milestone: ---Keywords: Reopened
Target Release: ---   
Hardware: x86_64   
OS: Unspecified   
URL: https://retrace.fedoraproject.org/faf/reports/bthash/4f73bef970cbc4e6a1e855de95e0b44c144d5fcc
Whiteboard: abrt_hash:6c787f47ba78cd2c0917622079443682fb850493;VARIANT_ID=workstation;
Fixed In Version: sssd-1.14.1-1.fc25 sssd-1.14.1-2.fc24 sssd-1.14.1-2.fc23 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-09-10 20:55:00 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
File: backtrace
none
File: cgroup
none
File: core_backtrace
none
File: dso_list
none
File: environ
none
File: limits
none
File: maps
none
File: mountinfo
none
File: namespaces
none
File: open_fds
none
File: proc_pid_status
none
File: var_log_messages
none
sssd.conf none

Description Pierre Ossman 2016-06-15 11:17:41 UTC 
Version-Release number of selected component:
sssd-common-1.13.4-3.fc23

Additional info:
reporter:       libreport-2.6.4
backtrace_rating: 4
cmdline:        /usr/sbin/sssd -D -f
crash_function: talloc_abort
executable:     /usr/sbin/sssd
global_pid:     989
kernel:         4.5.5-201.fc23.x86_64
runlevel:       N 5
type:           CCpp
uid:            0

Truncated backtrace:
Thread no. 1 (10 frames)
 #2 talloc_abort at ../talloc.c:399
 #3 talloc_abort_unknown_value at ../talloc.c:417
 #4 talloc_chunk_from_ptr at ../talloc.c:436
 #5 __talloc_get_name at ../talloc.c:1419
 #6 talloc_check_name at ../talloc.c:1442
 #7 ping_check at src/monitor/monitor.c:2565
 #8 complete_pending_call_and_unlock at ../../dbus/dbus-connection.c:2331
 #10 sbus_dispatch at src/sbus/sssd_dbus_connection.c:96
 #11 tevent_common_loop_timer_delay at ../tevent_timed.c:341
 #12 epoll_event_loop_once at ../tevent_epoll.c:911

Potential duplicate: bug 976573
Comment 1 Pierre Ossman 2016-06-15 11:17:49 UTC 
Created attachment 1168322 [details]
File: backtrace
Comment 2 Pierre Ossman 2016-06-15 11:17:50 UTC 
Created attachment 1168323 [details]
File: cgroup
Comment 3 Pierre Ossman 2016-06-15 11:17:52 UTC 
Created attachment 1168324 [details]
File: core_backtrace
Comment 4 Pierre Ossman 2016-06-15 11:17:53 UTC 
Created attachment 1168325 [details]
File: dso_list
Comment 5 Pierre Ossman 2016-06-15 11:17:54 UTC 
Created attachment 1168326 [details]
File: environ
Comment 6 Pierre Ossman 2016-06-15 11:17:56 UTC 
Created attachment 1168327 [details]
File: limits
Comment 7 Pierre Ossman 2016-06-15 11:17:58 UTC 
Created attachment 1168328 [details]
File: maps
Comment 8 Pierre Ossman 2016-06-15 11:18:00 UTC 
Created attachment 1168329 [details]
File: mountinfo
Comment 9 Pierre Ossman 2016-06-15 11:18:01 UTC 
Created attachment 1168330 [details]
File: namespaces
Comment 10 Pierre Ossman 2016-06-15 11:18:03 UTC 
Created attachment 1168331 [details]
File: open_fds
Comment 11 Pierre Ossman 2016-06-15 11:18:04 UTC 
Created attachment 1168332 [details]
File: proc_pid_status
Comment 12 Pierre Ossman 2016-06-15 11:18:06 UTC 
Created attachment 1168333 [details]
File: var_log_messages
Comment 13 Lukas Slebodnik 2016-06-15 17:43:11 UTC 
Pierre,
could you also attach coredump?

Are you able to reproduce it more often or it happened only once
Comment 14 Pierre Ossman 2016-06-16 07:26:01 UTC 
Sorry, I tend to clean out abrt once things are reported.

This has only happened once AFAIK. No idea what triggered it. I came back to my machine and all of a sudden I couldn't look up my own user anymore.
Comment 15 Jakub Hrozek 2016-06-16 09:23:43 UTC 
(In reply to Pierre Ossman from comment #14)
> Sorry, I tend to clean out abrt once things are reported.
> 
> This has only happened once AFAIK. No idea what triggered it. I came back to
> my machine and all of a sudden I couldn't look up my own user anymore.

Can you please check journald around that time if there was maybe some large disk activity that would have blocked the process?

Do you use enumerate=true in sssd.conf? Can you upload your sssd.conf? (Sanitize hostnames or other confidential info if needed).
Comment 16 Pierre Ossman 2016-06-16 09:59:55 UTC 
Some logs:

$ sudo journalctl -u sssd:

> Jun 08 11:34:03 ossman.lkpg.cendio.se systemd[1]: Started System Security Services Daemon.
> Jun 15 11:04:39 ossman.lkpg.cendio.se sssd[989]: Killing service [autofs], not responding to pings!
> Jun 15 11:06:23 ossman.lkpg.cendio.se systemd[1]: sssd.service: Main process exited, code=dumped, status=6/ABRT
> Jun 15 11:06:23 ossman.lkpg.cendio.se systemd[1]: sssd.service: Unit entered failed state.
> Jun 15 11:06:23 ossman.lkpg.cendio.se systemd[1]: sssd.service: Failed with result 'core-dump'.

In the full log there is nothing obvious before the kill, but the OOM triggers soon afterwards:

> Jun 15 11:01:01 ossman.lkpg.cendio.se CROND[6650]: (root) CMD (run-parts /etc/cron.hourly)
> Jun 15 11:01:02 ossman.lkpg.cendio.se run-parts[6653]: (/etc/cron.hourly) starting 0anacron
> Jun 15 11:01:02 ossman.lkpg.cendio.se run-parts[6659]: (/etc/cron.hourly) finished 0anacron
> Jun 15 11:01:02 ossman.lkpg.cendio.se run-parts[6661]: (/etc/cron.hourly) starting mcelog.cron
> Jun 15 11:01:02 ossman.lkpg.cendio.se run-parts[6665]: (/etc/cron.hourly) finished mcelog.cron
> Jun 15 11:04:11 ossman.lkpg.cendio.se hamster-time-tracker.desktop[11546]: ERROR:root:Error while refreshing: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote appl
> Jun 15 11:04:39 ossman.lkpg.cendio.se sssd[989]: Killing service [autofs], not responding to pings!
> Jun 15 11:05:14 ossman.lkpg.cendio.se CROND[9638]: (root) CMD (/opt/thinlinc/sbin/tl-collect-licensestats)
> Jun 15 11:06:22 ossman.lkpg.cendio.se kernel: cc1plus invoked oom-killer: gfp_mask=0x24201ca, order=0, oom_score_adj=0

The offender seems to have been thunderbird:

> Jun 15 11:06:23 ossman.lkpg.cendio.se kernel: Out of memory: Kill process 29928 (thunderbird) score 434 or sacrifice child
> Jun 15 11:06:23 ossman.lkpg.cendio.se kernel: Killed process 29928 (thunderbird) total-vm:8686200kB, anon-rss:7068116kB, file-rss:0kB, shmem-rss:2112kB
Comment 17 Pierre Ossman 2016-06-16 10:00:55 UTC 
Created attachment 1168659 [details]
sssd.conf
Comment 18 Lukas Slebodnik 2016-08-19 17:56:39 UTC 
"Ping"-related checking of processes was removed in sssd-1.14.x
Comment 19 Fedora Update System 2016-08-19 17:59:48 UTC 
sssd-1.14.1-1.fc25 has been submitted as an update to Fedora 25. https://bodhi.fedoraproject.org/updates/FEDORA-2016-e2a7cf208d
Comment 20 Fedora Update System 2016-08-19 18:00:44 UTC 
sssd-1.14.1-1.fc23 has been submitted as an update to Fedora 23. https://bodhi.fedoraproject.org/updates/FEDORA-2016-15f767c98e
Comment 21 Fedora Update System 2016-08-19 18:23:03 UTC 
sssd-1.14.1-1.fc24 has been submitted as an update to Fedora 24. https://bodhi.fedoraproject.org/updates/FEDORA-2016-80fb0ddfb2
Comment 22 Fedora Update System 2016-08-20 18:50:27 UTC 
sssd-1.14.1-1.fc25 has been pushed to the Fedora 25 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-e2a7cf208d
Comment 23 Fedora Update System 2016-08-21 04:22:34 UTC 
sssd-1.14.1-1.fc23 has been pushed to the Fedora 23 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-15f767c98e
Comment 24 Fedora Update System 2016-08-21 04:24:37 UTC 
sssd-1.14.1-1.fc24 has been pushed to the Fedora 24 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-80fb0ddfb2
Comment 25 Fedora Update System 2016-08-27 10:19:22 UTC 
sssd-1.14.1-1.fc25 has been pushed to the Fedora 25 stable repository. If problems still persist, please make note of it in this bug report.
Comment 26 Fedora Update System 2016-09-01 17:55:13 UTC 
sssd-1.14.1-2.fc24 has been submitted as an update to Fedora 24. https://bodhi.fedoraproject.org/updates/FEDORA-2016-84e9c107c2
Comment 27 Fedora Update System 2016-09-01 17:55:55 UTC 
sssd-1.14.1-2.fc23 has been submitted as an update to Fedora 23. https://bodhi.fedoraproject.org/updates/FEDORA-2016-7053443264
Comment 28 Fedora Update System 2016-09-03 03:24:10 UTC 
sssd-1.14.1-2.fc24 has been pushed to the Fedora 24 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-84e9c107c2
Comment 29 Fedora Update System 2016-09-03 03:53:22 UTC 
sssd-1.14.1-2.fc23 has been pushed to the Fedora 23 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-7053443264
Comment 30 Fedora Update System 2016-09-10 20:54:49 UTC 
sssd-1.14.1-2.fc24 has been pushed to the Fedora 24 stable repository. If problems still persist, please make note of it in this bug report.
Comment 31 Fedora Update System 2016-09-12 06:51:04 UTC 
sssd-1.14.1-2.fc23 has been pushed to the Fedora 23 stable repository. If problems still persist, please make note of it in this bug report.