Bug 1940678

Summary:	pulp3: excess memory consumption when importing errata during pulp3 migration
Product:	Red Hat Satellite	Reporter:	Justin Sherrill <jsherril>
Component:	Repositories	Assignee:	Justin Sherrill <jsherril>
Status:	CLOSED ERRATA	QA Contact:	Tasos Papaioannou <tpapaioa>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	6.9.0	CC:	juwatts, pcreech
Target Milestone:	6.9.0	Keywords:	Triaged
Target Release:	Unused
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	tfm-rubygem-katello-3.18.1.22-1	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2021-04-21 13:26:20 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Justin Sherrill 2021-03-18 20:39:25 UTC

Description of problem:

On a system with a LOT of repositories, during migration the sidekiq worker for dynflow will consume ~16GB, which is way too much. 

We need to look at breaking up the errata import process to not consume as much memory.

In this case, there were ~25,000 errata, and 21,153,436 errata <-> repo associations (the biggest issue)

Comment 1 Justin Sherrill 2021-03-18 20:40:08 UTC

And here was we witnessed in /var/log/foreman/production.log:

2021-03-18T15:07:35 [E|bac|] failed to allocate memory (NoMemoryError)
 |
2021-03-18T15:07:35 [I|bac|] Task {label: Actions::Pulp3::ContentMigration, id: 91601a75-10d2-47bb-af1e-891c91efeb2e, execution_plan_id: ac7599d1-e114-42ec-9db4-02ae0eadb41d} state changed: stopped  result: warning
2021-03-18T15:07:35 [I|bac|] Task {label: Actions::Pulp3::ContentMigration, id: 91601a75-10d2-47bb-af1e-891c91efeb2e, execution_plan_id: ac7599d1-e114-42ec-9db4-02ae0eadb41d} state changed: stopped  result: warning


There was also a dynflow traceback in /var/log/messages, but that was likely more of a side effect

Comment 2 Justin Sherrill 2021-03-19 16:10:46 UTC

Created redmine issue https://projects.theforeman.org/issues/32142 from this bug

Comment 4 Tasos Papaioannou 2021-03-29 20:39:10 UTC

Verified on 6.9.0 snap 19.1.

Comment 7 errata-xmlrpc 2021-04-21 13:26:20 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Satellite 6.9 Release), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:1313