Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1889005

Summary: /var/cache/pulp size recommendations in the documentation are outdated and can lead to filesystem fill-up situations
Product: Red Hat Satellite Reporter: Pablo Hess <phess>
Component: DocumentationAssignee: Suyog Sainkar <ssainkar>
Status: CLOSED NEXTRELEASE QA Contact: Devendra Singh <desingh>
Severity: medium Docs Contact: Sergei Petrosian <spetrosi>
Priority: high    
Version: 6.7.0CC: desingh, dvoss, kkinge, ktordeur, mawerner, peter.vreman, pmoravec, ramsingh, rkarimpa, saydas, spetrosi, ssainkar
Target Milestone: 6.9.0   
Target Release: Unused   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-02-15 22:13:45 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Pablo Hess 2020-10-16 18:37:40 UTC
Document URL: 
https://access.redhat.com/documentation/en-us/red_hat_satellite/6.7/html-single/installing_satellite_server_from_a_connected_network/index#satellite-storage-requirements_satellite

Section Number and Name: 
1.2. Storage Requirements


Describe the issue: 
The session suggests a maximum size of 20 GB for the /var/cache/pulp filesystem. We have increasing numbers of support cases where customers fill up /var/cache/pulp with either yum repo metadata (the "*-other.xml.gz" metadata file for rhel-7-server-rpms is now 3.7+ GB in size) or, significantly worse, with container image blobs. One case in particular with a customer making heavy use of Satellite for docker contents, has /var/cache/pulp use upwards of 90 GB during syncs.

The documentation suggests /var/cache/pulp lives in the same filesystem as /var/lib/pulp so moving files is just a quick inode operation. Maybe this needs to be a requirement going forward?

Otherwise, we need to make it very clear that /var/cache/pulp size needs to increase according to docker repo usage.

At the very least, thinking of an 8-worker pulp generating the "other.xml.gz" metadata for rhel-7-server-rpms at the same time, the current space used for /var/cache/pulp needs to be 8 x 4 GB = 32 GB.

Suggestions for improvement: 
It really depends on the approach. Turning to mandatory /var/cache/pulp residing with /var/lib/pulp would be one thing, whereas increasing the minimum size to 32 GB would be very different and less of a change.

Comment 1 Kenny Tordeurs 2020-11-08 10:33:57 UTC
/var/cache/pulp residing on /var/lib/pulp -> https://bugzilla.redhat.com/show_bug.cgi?id=1891000

increasing the minimum size to 32 GB in the docs will be a quick fix but we'll probably also have to include some extra check in foreman-maintain as people upgrading might not be aware of the change in space requirements.

Comment 2 Pavel Moravec 2020-11-19 12:44:47 UTC
See also:

https://bugzilla.redhat.com/show_bug.cgi?id=1891000 : Consider having /var/cache/pulp under /var/lib/pulp

https://access.redhat.com/solutions/5586261 : Is it safe to symlink pulp cache to /var/lib/pulp for Satellite6 or its Capsule?

Comment 10 Suyog Sainkar 2021-03-08 18:07:20 UTC
*** Bug 1883930 has been marked as a duplicate of this bug. ***