Bug 1106594

Summary: huge stack allocation in rpmDoDigest() function
Product: [Fedora] Fedora Reporter: Peter Schiffer <pschiffe>
Component: rpmAssignee: Panu Matilainen <pmatilai>
Status: CLOSED ERRATA QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: high Docs Contact:
Priority: unspecified    
Version: 20CC: jzeleny, novyjindrich, packaging-team-maint, pknirsch, pmatilai
Target Milestone: ---Keywords: Upstream
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Fixed In Version: rpm-4.11.3-1.fc20 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-09-19 09:58:43 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Description Flags
rpm-4.11.2-dynamic-buf-allocation.patch none

Description Peter Schiffer 2014-06-09 16:05:12 UTC
Description of problem:
In function rpmDoDigest() (from rpmio/rpmfileutil.c file, line 143) variable buf is declared as: unsigned char buf[32*BUFSIZ]. Currently, BUFSIZ from stdio.h has value of 8192, which makes the buf variable take 256KB from stack. And this looks like a problem. I'm using rpmDoDigest() and rpmVerifyFile() functions in software provider in OpenLMI project. These providers are running under cimserver, and when I try to call the mentioned functions there, it crashes. Unfortunately, I wasn't able to reproduce the issue outside of cimserver.

I'll attach the abrt data of the crash (which is not very useful) and example patch which fixes the problem for me.

Version-Release number of selected component (if applicable):

Comment 1 Peter Schiffer 2014-06-09 16:06:00 UTC
Created attachment 904784 [details]

abrt data of the crash

Comment 2 Peter Schiffer 2014-06-09 16:06:48 UTC
Created attachment 904785 [details]

example patch fixing the problem for me

Comment 3 Panu Matilainen 2014-06-11 08:05:05 UTC
256KB is no more than 1/32 of the default 8MB stack limit, I suspect cimserver/providers are actually the bigger stack hog :)

That said, there's no reason (never mind a good one) for such a large stack allocation in rpmDoDigest() as performance is always going to be limited on physical IO + digest calculation, not allocation speed. Will fix.

Comment 5 Fedora Update System 2014-09-08 06:56:28 UTC
rpm-4.11.3-1.fc20 has been submitted as an update for Fedora 20.

Comment 6 Fedora Update System 2014-09-09 22:05:16 UTC
Package rpm-4.11.3-1.fc20:
* should fix your issue,
* was pushed to the Fedora 20 testing repository,
* should be available at your local mirror within two days.
Update it with:
# su -c 'yum update --enablerepo=updates-testing rpm-4.11.3-1.fc20'
as soon as you are able to.
Please go to the following url:
then log in and leave karma (feedback).

Comment 7 Fedora Update System 2014-09-16 07:49:59 UTC
rpm-4.11.3-1.fc19 has been submitted as an update for Fedora 19.

Comment 8 Fedora Update System 2014-09-19 09:58:43 UTC
rpm-4.11.3-1.fc20 has been pushed to the Fedora 20 stable repository.  If problems still persist, please make note of it in this bug report.

Comment 9 Fedora Update System 2014-10-04 03:27:01 UTC
rpm-4.11.3-1.fc19 has been pushed to the Fedora 19 stable repository.  If problems still persist, please make note of it in this bug report.