Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 2059660 - [RFE]: Have Candlepin peform jobs in batches as opposed to all
Summary: [RFE]: Have Candlepin peform jobs in batches as opposed to all
Keywords:
Status: CLOSED WONTFIX
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Candlepin
Version: 6.9.6
Hardware: x86_64
OS: Linux
unspecified
high
Target Milestone: Unspecified
Assignee: satellite6-bugs
QA Contact: Vladimír Sedmík
URL:
Whiteboard:
Depends On: 2069126
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-03-01 16:30 UTC by Taft Sanders
Modified: 2023-10-06 10:59 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 2069126 (view as bug list)
Environment:
Last Closed: 2023-10-06 10:59:23 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 1972501 1 medium CLOSED After promoting the content view, Candlepin failed to mark the entitlement certificates as dirty 2024-10-01 18:38:42 UTC
Red Hat Issue Tracker ENT-4782 0 None None None 2022-03-03 15:47:16 UTC
Red Hat Issue Tracker ENT-4852 0 None None None 2022-03-28 10:45:45 UTC
Red Hat Issue Tracker SAT-8734 0 None None None 2022-03-02 18:32:04 UTC

Description Taft Sanders 2022-03-01 16:30:32 UTC 
Description of problem:
It has been identified that the following candlepin jobs will run with very long times and potentially fail with memory issues on tomcat:

ExpiredPoolsCleanupJob
RegenEnvEntitlementCertsJob

Version-Release number of selected component (if applicable):
Satellite 6.9.6-1
candlepin-3.1.28-1

How reproducible:
Every time

Steps to Reproduce:
1. Have a Satellite with 54,000 hosts with 1 subscription expire at the same time.
2. Watch tomcat usage reach 24GB+ memory usage
3.

Actual results:
Multiple attempts to complete the job as it has a restart if memory issues are encountered.
Long run times for these jobs with thousands of hosts

Expected results:
The job should be run in smaller batches assumed from a value in the configuration file.
IE:
while ExpiredPoolsExist:
  PoolBatchSize = config.parser(candlepin.poolbatchsize)
  if PoolBatchSize = '':
    set PoolBatchSize = 2000
  ExpiredPoolsCleanupJob(ExpiredPoolsList[:PoolBatchSize])

Additional info:
Configuring this for large deployments would also be needed to be added for the performance tuning guide as more memory is allocated to tomcat to process larger batches.
Comment 3 Nikos Moumoulidis 2022-03-21 11:20:44 UTC 
Hi Taft,

Can you confirm whether Entitlement mode (versus SCA) was used in this deployment?

Thanks,
Nikos
Comment 4 Taft Sanders 2022-03-24 14:14:46 UTC 
(In reply to Nikos Moumoulidis from comment #3)
> Hi Taft,
> 
> Can you confirm whether Entitlement mode (versus SCA) was used in this
> deployment?
> 
> Thanks,
> Nikos

I can confirm SCA was NOT enabled on the account/Satellite.
Comment 11 Nikos Moumoulidis 2023-10-06 10:59:23 UTC 
While this is a valid issue, it only affects very large environents(in terms of numbers of hosts) in Entitlement Mode, and would require a high effort fix.
With Simple Content Access mode being the preferred method for accessing content, we have focused our efforts on that and decided not to fix this.
Note You need to log in before you can comment on or make changes to this bug.