Bug 1599074 - squid: 3 coredumps every day
Summary: squid: 3 coredumps every day
Keywords:
Status: CLOSED RAWHIDE
Alias: None
Product: Fedora
Classification: Fedora
Component: squid
Version: 28
Hardware: x86_64
OS: Linux
unspecified
medium
Target Milestone: ---
Assignee: Luboš Uhliarik
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-07-08 14:19 UTC by redhat
Modified: 2023-11-19 13:02 UTC (History)
6 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed: 2019-05-17 13:48:38 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
One core dump from many (11.29 MB, application/octet-stream)
2018-07-08 14:19 UTC, redhat
no flags Details

Description redhat 2018-07-08 14:19:01 UTC
Created attachment 1457282 [details]
One core dump from many

Description of problem:
Since upgrade to the latest squid package it dumps core three times every day.

rw-r-----. 1 root root 11834782  7. Jul 13:39 core.squid.23.817643a7077a43178212cb50eb017f1c.10172.1530963592000000.lz4
-rw-r-----. 1 root root 11843898  7. Jul 13:44 core.squid.23.817643a7077a43178212cb50eb017f1c.10656.1530963897000000.lz4
-rw-r-----. 1 root root 11823982  7. Jul 13:49 core.squid.23.817643a7077a43178212cb50eb017f1c.11201.1530964162000000.lz4
-rw-r-----. 1 root root 25612985  8. Jul 08:35 core.squid.23.817643a7077a43178212cb50eb017f1c.11668.1531031708000000.lz4
-rw-r-----. 1 root root 22313909  6. Jul 17:38 core.squid.23.817643a7077a43178212cb50eb017f1c.21689.1530891499000000.lz4
-rw-r-----. 1 root root 11938782  7. Jul 07:58 core.squid.23.817643a7077a43178212cb50eb017f1c.31261.1530943121000000.lz4
-rw-r-----. 1 root root 11756279  7. Jul 08:02 core.squid.23.817643a7077a43178212cb50eb017f1c.31744.1530943320000000.lz4
-rw-r-----. 1 root root 19127067  7. Jul 13:35 core.squid.23.817643a7077a43178212cb50eb017f1c.32192.1530963323000000.lz4
-rw-r-----. 1 root root 80011340  6. Jul 05:58 core.squid.23.817643a7077a43178212cb50eb017f1c.3238.1530849514000000.lz4
-rw-r-----. 1 root root 11776351  6. Jul 17:43 core.squid.23.817643a7077a43178212cb50eb017f1c.4497.1530891803000000.lz4
-rw-r-----. 1 root root 11688477  6. Jul 17:57 core.squid.23.817643a7077a43178212cb50eb017f1c.5161.1530892640000000.lz4
-rw-r-----. 1 root root 26635575  7. Jul 07:54 core.squid.23.817643a7077a43178212cb50eb017f1c.6628.1530942860000000.lz4


Version-Release number of selected component (if applicable):
squid-4.0.25-1.fc28

How reproducible:
Happens every day.

Steps to Reproduce:
1. Don't know
2.
3.

Actual results:
Coredump

Expected results:
No coredump

Additional info:

Comment 1 Luboš Uhliarik 2018-07-09 12:46:32 UTC
Hi,

what was your former version, which was running without crashes?

Comment 2 redhat 2018-07-12 15:56:36 UTC
Well, if you tell me how to find out this information from of my system. I only know of `rpm -qa --latest`.

Comment 3 Luboš Uhliarik 2018-07-12 22:08:21 UTC
Do you remember, when did you update your squid?

Try command:

$ sudo dnf history

Then you will see list of operations with their own IDs. You can inspect specific ID by following command:

$ sudo dnf history info <ID>

Comment 4 redhat 2018-07-13 09:15:50 UTC
# dnf history|grep update|awk '{print $1}'|xargs dnf history info|grep squid
    Upgraded squid-7:4.0.23-2.fc28.x86_64                            @fedora
   1 Warnung: /etc/squid/squid.conf erstellt als /etc/squid/squid.conf.rpmnew
    Upgraded squid-7:4.0.21-1.fc27.x86_64                          @fedora/27
Command Line   : update squid.x86_64
    Upgraded squid-7:4.0.11-1.fc25.x86_64 @fedora/25

Comment 5 redhat 2018-07-30 15:45:45 UTC
           PID: 1830 (squid)
           UID: 23 (squid)
           GID: 23 (squid)
        Signal: 6 (ABRT)
     Timestamp: Sun 2018-07-29 09:15:37 CEST (1 day 8h ago)
  Command Line: (squid-1) --kid squid-1 -f /etc/squid/squid.conf
    Executable: /usr/sbin/squid
 Control Group: /system.slice/squid.service
          Unit: squid.service
         Slice: system.slice
       Boot ID: afa847893dff4ef2bb75ab23404bd2f9
    Machine ID: e11622fca54a439a9b3954265d001569
      Hostname: manicminer.lan.zx-spectrum
       Storage: /var/lib/systemd/coredump/core.squid.23.afa847893dff4ef2bb75ab23404bd2f9.1830.1532848537000000.lz4
       Message: Process 1830 (squid) of user 23 dumped core.
                
                Stack trace of thread 1830:
                #0  0x00007f3b19485feb raise (libc.so.6)
                #1  0x00007f3b194705c1 abort (libc.so.6)
                #2  0x00005602e3216369 xassert.cold.41 (squid)
                #3  0x00005602e33a8ee5 _ZN7mem_hdr12freeDataUptoEl (squid)
                #4  0x00005602e3369066 _ZN9MemObject13trimSwappableEv (squid)
                #5  0x00005602e33b1855 _ZN10StoreEntry10trimMemoryEb (squid)
                #6  0x00005602e366af58 _ZN5Store10Controller9memoryOutER10StoreEntryb (squid)
                #7  0x00005602e33c1529 _ZN10StoreEntry7swapOutEv (squid)
                #8  0x00005602e33b851a _ZN10StoreEntry14invokeHandlersEv (squid)
                #9  0x00005602e33abe00 _ZN10StoreEntry5writeE13StoreIOBuffer (squid)
                #10 0x00005602e344fc04 _ZN6Client14storeReplyBodyEPKcl (squid)
                #11 0x00005602e332c3eb _ZN13HttpStateData14writeReplyBodyEv (squid)
                #12 0x00005602e3332b65 _ZN13HttpStateData16processReplyBodyEv (squid)
                #13 0x00005602e3334962 _ZN13HttpStateData12processReplyEv (squid)
                #14 0x00005602e33362c2 _ZN13HttpStateData9readReplyERK14CommIoCbParams (squid)
                #15 0x00005602e33395af _ZN9JobDialerI13HttpStateDataE4dialER9AsyncCall (squid)
                #16 0x00005602e34a2a81 _ZN9AsyncCall4makeEv (squid)
                #17 0x00005602e34a4028 _ZN14AsyncCallQueue8fireNextEv (squid)
                #18 0x00005602e34a437d _ZN14AsyncCallQueue4fireEv (squid)
                #19 0x00005602e32f7660 _ZN9EventLoop7runOnceEv (squid)
                #20 0x00005602e32f7758 _ZN9EventLoop3runEv (squid)
                #21 0x00005602e3364a77 _Z9SquidMainiPPc (squid)
                #22 0x00005602e323e6f5 main (squid)
                #23 0x00007f3b1947224b __libc_start_main (libc.so.6)
                #24 0x00005602e3249f6a _start (squid)

Comment 6 redhat 2018-09-02 08:05:48 UTC
Squid squid-4.2-2.fc28 came with latest updated and it got even worse:

-rw-r-----. 1 root root 30303484  2. Sep 08:38 core.squid.23.4a4d7dacc5824b188692e5b9e15880d4.3357.1535870325000000.lz4
-rw-r-----. 1 root root 32710195 31. Aug 18:12 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.19485.1535731961000000.lz4
-rw-r-----. 1 root root 34589715 30. Aug 05:57 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.22624.1535601446000000.lz4
-rw-r-----. 1 root root 15235190  1. Sep 08:47 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.4115.1535784477000000.lz4
-rw-r-----. 1 root root 12849988  1. Sep 13:24 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.5653.1535801055000000.lz4
-rw-r-----. 1 root root 12997716  1. Sep 13:31 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.6156.1535801504000000.lz4
-rw-r-----. 1 root root 13076869  1. Sep 13:36 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.6957.1535801768000000.lz4
-rw-r-----. 1 root root 12931517  1. Sep 13:41 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.7440.1535802063000000.lz4
-rw-r-----. 1 root root 13119596  1. Sep 13:45 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.8030.1535802328000000.lz4
-rw-r-----. 1 root root 24823793  1. Sep 13:19 core.squid.23.5d778bf97c1a4d259a62e1087287b83c.9594.1535800787000000.lz4

Core was generated by `(squid-1) --kid squid-1 -f /etc/squid/squid.conf'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fcb2d92ffeb in raise () from /lib64/libc.so.6
[Current thread is 1 (Thread 0x7fcb30e78c80 (LWP 3357))]
Missing separate debuginfos, use: dnf debuginfo-install squid-4.2-2.fc28.x86_64
(gdb) bt
#0  0x00007fcb2d92ffeb in raise () from /lib64/libc.so.6
#1  0x00007fcb2d91a5c1 in abort () from /lib64/libc.so.6
#2  0x000055a2a215be07 in xassert.cold ()
#3  0x000055a2a22f4685 in mem_hdr::freeDataUpto(long) ()
#4  0x000055a2a22af106 in MemObject::trimSwappable() ()
#5  0x000055a2a22fd0f5 in StoreEntry::trimMemory(bool) ()
#6  0x000055a2a25b78e8 in Store::Controller::memoryOut(StoreEntry&, bool) ()
#7  0x000055a2a230cfb9 in StoreEntry::swapOut() ()
#8  0x000055a2a2303cf5 in StoreEntry::invokeHandlers() ()
#9  0x000055a2a22fbba1 in StoreEntry::write(StoreIOBuffer) ()
#10 0x000055a2a2398034 in Client::storeReplyBody(char const*, long) ()
#11 0x000055a2a227238b in HttpStateData::writeReplyBody() ()
#12 0x000055a2a2278b05 in HttpStateData::processReplyBody() ()
#13 0x000055a2a227a912 in HttpStateData::processReply() ()
#14 0x000055a2a227c272 in HttpStateData::readReply(CommIoCbParams const&) ()
#15 0x000055a2a227f55f in JobDialer<HttpStateData>::dial(AsyncCall&) ()
#16 0x000055a2a23eae41 in AsyncCall::make() ()
#17 0x000055a2a23ec3e8 in AsyncCallQueue::fireNext() ()
#18 0x000055a2a23ec73d in AsyncCallQueue::fire() ()
#19 0x000055a2a223d560 in EventLoop::runOnce() ()
#20 0x000055a2a223d658 in EventLoop::run() ()
#21 0x000055a2a22aab17 in SquidMain(int, char**) ()
#22 0x000055a2a2184125 in main ()
(gdb)

Comment 7 Luboš Uhliarik 2018-09-03 14:52:26 UTC
I reported this issue to upstream:

https://bugs.squid-cache.org/show_bug.cgi?id=4823

Comment 8 redhat 2019-04-28 11:59:11 UTC
The problem still persists with squid-4.4-1.fc29 with the very same stack backtrace.
BTW the URL https://bugs.squid-cache.org/show_bug.cgi?id=4823 does not work for me.

Comment 9 Luboš Uhliarik 2019-04-29 10:33:49 UTC
I can access URL without problem. Anyway, this bug should be fixed in v5. I backported that patch and build it for rawhide, can you test it?

https://koji.fedoraproject.org/koji/taskinfo?taskID=34523409

Comment 10 Ben Cotton 2019-05-02 19:38:09 UTC
This message is a reminder that Fedora 28 is nearing its end of life.
On 2019-May-28 Fedora will stop maintaining and issuing updates for
Fedora 28. It is Fedora's policy to close all bug reports from releases
that are no longer maintained. At that time this bug will be closed as
EOL if it remains open with a Fedora 'version' of '28'.

Package Maintainer: If you wish for this bug to remain open because you
plan to fix it in a currently maintained version, simply change the 'version' 
to a later Fedora version.

Thank you for reporting this issue and we are sorry that we were not 
able to fix it before Fedora 28 is end of life. If you would still like 
to see this bug fixed and are able to reproduce it against a later version 
of Fedora, you are encouraged  change the 'version' to a later Fedora 
version prior this bug is closed as described in the policy above.

Although we aim to fix as many bugs as possible during every release's 
lifetime, sometimes those efforts are overtaken by events. Often a 
more recent Fedora release includes newer upstream software that fixes 
bugs or makes them obsolete.

Comment 11 Luboš Uhliarik 2019-05-17 12:49:14 UTC
Fix was committed to 4.7 release. I will update squid to 4.7 ASAP and let me know if the issue still persists.

Comment 12 Luboš Uhliarik 2019-05-17 13:48:38 UTC
This issue should be fixed in squid-4.7-1.fc31 -> closing.

In case you experience this issue again, feel free to reopen.

Comment 13 dag 2023-11-19 13:01:58 UTC
Think this is back in the newest FC38 squid ??

Backtrace here:

Core was generated by `(squid-1) --kid squid-1 --foreground -f /etc/squid/squid.conf'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f4a896b0884 in __pthread_kill_implementation () from /lib64/libc.so.6
Thread 1 (Thread 0x7f4a89a89900 (LWP 2425)):
#0  0x00007f4a896b0884 in __pthread_kill_implementation () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007f4a8965fafe in raise () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007f4a8964887f in abort () from /lib64/libc.so.6
No symbol table info available.
#3  0x000055dc616f50ba in xassert ()
No symbol table info available.
#4  0x000055dc614f9fbc in mem_hdr::freeDataUpto(long) ()
No symbol table info available.
#5  0x000055dc61504e55 in StoreEntry::trimMemory(bool) ()
No symbol table info available.
#6  0x000055dc6151656d in StoreEntry::swapOut() ()
No symbol table info available.
#7  0x000055dc6150c61d in StoreEntry::invokeHandlers() ()
No symbol table info available.
#8  0x000055dc614fde9b in StoreEntry::write(StoreIOBuffer) ()
No symbol table info available.
#9  0x000055dc6158ae02 in Client::addVirginReplyBody(char const*, long) ()
No symbol table info available.
#10 0x000055dc614bac77 in HttpStateData::writeReplyBody() ()
No symbol table info available.
#11 0x000055dc614bb8b5 in HttpStateData::processReplyBody() ()
No symbol table info available.
#12 0x000055dc614b49c9 in HttpStateData::readReply(CommIoCbParams const&) ()
No symbol table info available.
#13 0x000055dc614ba8a5 in JobDialer<HttpStateData>::dial(AsyncCall&) ()
No symbol table info available.
#14 0x000055dc615e0e60 in AsyncCallQueue::fire() ()
No symbol table info available.
#15 0x000055dc613d5832 in EventLoop::runOnce() ()
No symbol table info available.
#16 0x000055dc614d2238 in SquidMain(int, char**) ()
No symbol table info available.
#17 0x000055dc6137bd96 in main ()

Comment 14 dag 2023-11-19 13:02:53 UTC
Squid version:
squid-6.4-1.fc38.x86_64


Note You need to log in before you can comment on or make changes to this bug.