Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1401331 - Small memory leak in wsgi process/script when invoking any pulp task
Summary: Small memory leak in wsgi process/script when invoking any pulp task
Keywords:
Status: CLOSED WONTFIX
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Pulp
Version: 6.2.5
Hardware: x86_64
OS: Linux
medium
medium
Target Milestone: Unspecified
Assignee: satellite6-bugs
QA Contact: Katello QA List
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-12-04 20:51 UTC by Pavel Moravec
Modified: 2021-12-10 14:49 UTC (History)
12 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2018-09-04 18:03:03 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Pulp Redmine 2492 0 Normal CLOSED - WONTFIX Small memory leak in httpd when dispatching Pulp tasks 2020-08-31 15:06:56 UTC

Description Pavel Moravec 2016-12-04 20:51:09 UTC
Description of problem:
Invoking a task in a loop causes memory consumption of wsgi:pulp processes slowly growing over time. Particular example when the increase was seen is creating a repo, uploading some RPM unit and deleting the repo - done in a loop. Since the wsgi script shall not depend on particular task type, I deduce the leak is generic and can occur by repetitive invoking any kind of pulp task.


Version-Release number of selected component (if applicable):
Sat 6.2.4
pulp-server-2.8.7.3-1.el7sat.noarch


How reproducible:
100% (in reasonable bigger time)


Steps to Reproduce:
(Satellite reproducer)
1. the reproducer itself:

hammer product create --name=custom_product --organization-id=1 --label=custom_product

while true; do
	date
	sleep 2
	hammer repository create --content-type=yum --download-policy=immediate --label=custom_repo --name=custom_repo --organization-id=1 --product=custom_product
	hammer repository delete --name=custom_repo --organization-id=1 --product=custom_product
done

2. monitor RSS of wsgi:pulp processes (there are multiple, just few of them really do a job and only those will have growing RSS). Example how I collected it:

i=0; while true; do date; ps aux | grep pulp | grep wsgi > ps.pulp.${i}.txt; sleep 300; i=$((i+1)); done

(and monitor it via:

for i in $(grep -v grep ps.pulp.0.txt | awk '{ print $2 }'); do echo $i; cat $(ls ps.pulp.*.txt -tr) | grep "^apache[ ]*$i "; echo; done

)

---
standalone pulp reproducer:

name="some-very-long-repo-name-some-very-long-repo-name-some-very-long-repo-name-test"

i=1;
while true; do
  pulp-admin rpm repo create --repo-id=${name}-${i} --display-name=${name}-${i}
  pulp-admin rpm repo delete --repo-id=${name}-${i} 
  sleep 2
done

(plus some ps monitoring)


Actual results:
RSS grows approx 110bytes per one task  /220bytes per one iteration of above cycle (sum of RSS increases per individual processes)


Expected results:
no RSS growth


Additional info:

Comment 3 Michael Hrivnak 2016-12-13 21:52:30 UTC
Brian, does this look familiar at all?

Comment 5 pulp-infra@redhat.com 2016-12-16 14:01:01 UTC
The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.

Comment 6 pulp-infra@redhat.com 2016-12-16 14:01:05 UTC
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.

Comment 7 pulp-infra@redhat.com 2016-12-19 19:06:11 UTC
The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.

Comment 9 pulp-infra@redhat.com 2018-01-29 11:33:59 UTC
The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.

Comment 10 Bryan Kearney 2018-09-04 18:03:03 UTC
Thank you for your interest in Satellite 6. We have evaluated this request, and we do not expect this to be implemented in the product in the foreseeable future. We are therefore closing this out as WONTFIX. If you have any concerns about this, please feel free to contact Rich Jerrido or Bryan Kearney. Thank you.

Comment 11 pulp-infra@redhat.com 2020-08-31 15:06:57 UTC
The Pulp upstream bug status is at CLOSED - WONTFIX. Updating the external tracker on this bug.


Note You need to log in before you can comment on or make changes to this bug.