RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 598498 - libc allocator in RHEL6: leaks anonymous mmap areas
Summary: libc allocator in RHEL6: leaks anonymous mmap areas
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: glibc
Version: 6.0
Hardware: All
OS: Linux
low
high
Target Milestone: rc
: ---
Assignee: Andreas Schwab
QA Contact: qe-baseos-tools-bugs
URL:
Whiteboard:
Depends On: 640286
Blocks:
TreeView+ depends on / blocked
 
Reported: 2010-06-01 14:04 UTC by Török Edwin
Modified: 2016-11-24 16:03 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2010-06-04 13:05:51 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
strace log (1.09 MB, text/plain)
2010-06-01 14:07 UTC, Török Edwin 		no flags Details
pmap of clamd on RHEL6 (4.21 KB, application/octet-stream)
2010-06-01 14:07 UTC, Török Edwin 		no flags Details
pmap of clamd on RHEL5 (4.53 KB, application/octet-stream)
2010-06-01 14:11 UTC, Török Edwin 		no flags Details
dmesg on RHEL6 (18.88 KB, application/octet-stream)
2010-06-01 14:11 UTC, Török Edwin 		no flags Details
View All

Description Török Edwin 2010-06-01 14:04:55 UTC 
Description of problem:
Running ClamAV's 'make check' on RHEL6 beta I get out of memory errors when running under ulimit -v 512000.
On RHEL5 it doesn't run out of memory (or on any other system either).

If I build tcmalloc, and link with -ltcmalloc then I do not get out of memory errors. Also if I run under valgrind I don't get out of memory errors (although valgrind itself uses quite some memory)!

Version-Release number of selected component (if applicable):
/lib64/libc.so.6
GNU C Library stable release version 2.11.1, by Roland McGrath et al.
Copyright (C) 2009 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
Compiled by GNU CC version 4.4.3 20100121 (Red Hat 4.4.3-1).
Compiled on a Linux >>2.6.18-164.11.1.el5<< system on 2010-02-25.
Available extensions:
	The C stubs add-on version 2.1.2.
	crypt add-on version 2.1 by Michael Glad and others
	GNU Libidn by Simon Josefsson
	Native POSIX Threads Library by Ulrich Drepper et al
	BIND-8.2.3-T5B
	RT using linux kernel aio
For bug reporting instructions, please see:
<http://www.gnu.org/software/libc/bugs.html>.


How reproducible:
Always

Steps to Reproduce:
1. Download ClamAV-0.96.1
$ wget http://downloads.sourceforge.net/clamav/clamav-0.96.1.tar.gz
2. ./configure --disable-llvm --disable-clamav CFLAGS="-O0 -g"
3. make -j2
4. cat >clamd.conf <<EOF
DatabaseDirectory /tmp/db
LocalSocket /tmp/clamd.socket
Foreground Yes
EOF
5. mkdir /tmp/db && cat >/tmp/db/last.hdb <<EOF
aa15bcf478d165efd2065190eb473bcb:544:ClamAV-Test-File
ccc692860fe80ed8b88334356878fe26:20:Internal-Test-Signature
EOF
6. ulimit -d 512000
7. ulimit -v 512000
8. clamd/clamd -c clamd.conf 2>log&
9. clamdscan/clamdscan -c clamd.conf -m test/.split/

Actual results:
/root/git/clamav-devel/test/.split/split.clam-mew.exeab:  Can't allocate memory
ERROR
...
Total errors: 34

Expected results:
No "Can't allocate memory" errors, and "Total errors: 0"

Additional info:
See ClamAV bugreport for more details: 
https://wwws.clamav.net/bugzilla/show_bug.cgi?id=1990
https://wwws.clamav.net/bugzilla/show_bug.cgi?id=1990#c6

I'm attaching the strace and pmap output.
Comment 2 Török Edwin 2010-06-01 14:07:18 UTC 
Created attachment 418648 [details]
strace log

./libtool --mode=execute strace -Ff clamd/clamd -c clamd.conf 2>strace_log&
Comment 3 Török Edwin 2010-06-01 14:07:59 UTC 
Created attachment 418649 [details]
pmap of clamd on RHEL6

pmap of clamd on RHEL6 after clamdscan completed
Comment 4 Török Edwin 2010-06-01 14:11:27 UTC 
Created attachment 418651 [details]
pmap of clamd on RHEL5

pmap of clamd on RHEL5:
Linux 2.6.18-92.1.13.el5xen x86_64 x86_64
/lib64/libc.so.6 
GNU C Library stable release version 2.5, by Roland McGrath et al.
Copyright (C) 2006 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
Compiled by GNU CC version 4.1.2 20071124 (Red Hat 4.1.2-41).
Compiled on a Linux 2.6.9 system on 2008-04-11.
Available extensions:
        The C stubs add-on version 2.1.2.
        crypt add-on version 2.1 by Michael Glad and others
        GNU Libidn by Simon Josefsson
        GNU libio by Per Bothner
        NIS(YP)/NIS+ NSS modules 0.19 by Thorsten Kukuk
        Native POSIX Threads Library by Ulrich Drepper et al
        BIND-8.2.3-T5B
        RT using linux kernel aio
Thread-local storage support included.
For bug reporting instructions, please see:
<http://www.gnu.org/software/libc/bugs.html>.
Comment 5 Török Edwin 2010-06-01 14:11:58 UTC 
Created attachment 418652 [details]
dmesg on RHEL6
Comment 6 Török Edwin 2010-06-01 14:12:45 UTC 
Note that on Debian unstable with same ulimit setting I do NOT get the out of memory, although libc version is almost the same.
$ uname -mrsp
Linux 2.6.34-00179-gdebb980 x86_64 unknown
$ /lib/libc.so.6 
GNU C Library (Debian EGLIBC 2.11.1-1) stable release version 2.11.1, by Roland McGrath et al.
Copyright (C) 2009 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
Compiled by GNU CC version 4.4.4.
Compiled on a Linux 2.6.32 system on 2010-05-29.
Available extensions:
        crypt add-on version 2.1 by Michael Glad and others
        GNU Libidn by Simon Josefsson
        Native POSIX Threads Library by Ulrich Drepper et al
        BIND-8.2.3-T5B
For bug reporting instructions, please see:
<http://www.debian.org/Bugs/>.
Comment 7 Török Edwin 2010-06-01 14:13:59 UTC 
Please let me know if you need additional information to debug this problem.
Right now this is a showstopper for us on RHEL6 beta.
Comment 8 RHEL Program Management 2010-06-02 18:05:46 UTC 
This request was evaluated by Red Hat Product Management for inclusion in a Red
Hat Enterprise Linux major release.  Product Management has requested further
review of this request by Red Hat Engineering, for potential inclusion in a Red
Hat Enterprise Linux Major release.  This request is not yet committed for
inclusion.
Comment 9 Andreas Schwab 2010-06-04 13:05:51 UTC 
These are not leaks but per-thread heaps.
Comment 10 Török Edwin 2010-06-04 13:42:05 UTC 
(In reply to comment #9)
> These are not leaks but per-thread heaps.    

OK, but that doesn't explain why it uses more memory than on Debian, the libc version is similar.
Is it possible to tune/trim the size of these heaps?
Comment 11 Andreas Schwab 2010-06-04 13:55:57 UTC 
--enable-experimental-malloc
Comment 12 Török Edwin 2010-06-04 14:04:02 UTC 
Thanks, I'll see if I can do anything to lower the memory usage of ClamAV under --enable-experimental-malloc.
Will the final RHEL6 have that flag enabled?
Comment 13 Török Edwin 2010-10-05 13:22:23 UTC 
Wrote a testcase and opened #640286, since I don't seem to be able to reopen this bug.
Note You need to log in before you can comment on or make changes to this bug.