Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1387314 - Errata applicability generate is taking a very long time
Summary: Errata applicability generate is taking a very long time
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Pulp
Version: 6.2.2
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: Unspecified
Assignee: satellite6-bugs
QA Contact: jcallaha
URL:
Whiteboard:
: 1388694 (view as bug list)
Depends On:
Blocks: 1389541
TreeView+ depends on / blocked
 
Reported: 2016-10-20 15:35 UTC by Brad Buckingham
Modified: 2021-04-06 17:55 UTC (History)
24 users (show)

Fixed In Version: pulp-rpm-2.8.7.4-1
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1389541 (view as bug list)
Environment:
Last Closed: 2016-11-10 08:14:37 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Pulp Redmine 2362 0 High CLOSED - CURRENTRELEASE applicability calculation wastes time scanning a list 2016-12-02 16:01:27 UTC
Red Hat Knowledge Base (Solution) 2726721 0 None None None 2016-10-25 23:09:23 UTC
Red Hat Product Errata RHBA-2016:2699 0 normal SHIPPED_LIVE Satellite 6.2.4 Async Bug Release 2016-11-10 13:12:22 UTC

Description Brad Buckingham 2016-10-20 15:35:23 UTC 
Description of problem:

It has been observed that applicability generation can take a very long time, potentially hours under certain conditions.

Investigation has been performed in the upstream and an issue created.  Creating this bugzilla to link it to the upstream issue and request inclusion of it in an upcoming release.
Comment 2 pulp-infra@redhat.com 2016-10-20 19:01:08 UTC 
The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.
Comment 3 pulp-infra@redhat.com 2016-10-20 19:01:10 UTC 
The Pulp upstream bug priority is at High. Updating the external tracker on this bug.
Comment 4 pulp-infra@redhat.com 2016-10-20 19:31:13 UTC 
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.
Comment 5 pulp-infra@redhat.com 2016-10-21 17:31:19 UTC 
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.
Comment 8 Marcelo Moreira de Mello 2016-10-25 23:04:32 UTC 
*** Bug 1388694 has been marked as a duplicate of this bug. ***
Comment 9 jcallaha 2016-11-07 19:44:07 UTC 
Verified in Satellite 6.2.4 Snap 2

errata applicability regeneration now takes 0.01s to 0.08s on a system with over 1,000 content hosts, each with approximately 150 applicable errata. See below output from /var/log/messages


Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[2ca3570d-2cfd-4e4e-9a05-d79c73a41d89] succeeded in 0.0422392729961s: None
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[757f44fd-2127-486b-a749-dc4e99efefd1]
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[757f44fd-2127-486b-a749-dc4e99efefd1] succeeded in 0.0402859799942s: None
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[12f833fb-66fd-4e7f-859b-6f7117d6d8c9]
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[12f833fb-66fd-4e7f-859b-6f7117d6d8c9] succeeded in 0.0592358709982s: None
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[328a682e-88e0-45ed-851c-e6da1b9b8845]
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[328a682e-88e0-45ed-851c-e6da1b9b8845] succeeded in 0.0405485439987s: None
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[cd3978eb-665d-4a53-8f34-9ef9b5558c1a]
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[cd3978eb-665d-4a53-8f34-9ef9b5558c1a] succeeded in 0.0464273560065s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[d18b054c-107b-4dc9-a0bc-1bec9eace0ed]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[d18b054c-107b-4dc9-a0bc-1bec9eace0ed] succeeded in 0.0129853700055s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[45cd5f59-ed87-44b9-9e4b-89292be4d62f]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[45cd5f59-ed87-44b9-9e4b-89292be4d62f] succeeded in 0.0404461589933s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[bbd648bd-8b53-43b7-807c-a897886973b2]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[bbd648bd-8b53-43b7-807c-a897886973b2] succeeded in 0.0126445479982s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[3e19427c-e088-4a39-88ac-a4374834c220]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[3e19427c-e088-4a39-88ac-a4374834c220] succeeded in 0.0147995179868s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[1abd2905-b68a-47e3-b598-5bf6e5e2294f]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[1abd2905-b68a-47e3-b598-5bf6e5e2294f] succeeded in 0.0126767230104s: None
Nov  7 14:07:42 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[ad08a361-c48a-44d4-90ea-57b11d4156f8]
Nov  7 14:07:42 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[ad08a361-c48a-44d4-90ea-57b11d4156f8] succeeded in 0.0132362349977s: None
Comment 11 errata-xmlrpc 2016-11-10 08:14:37 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:2699
Comment 12 pulp-infra@redhat.com 2016-11-21 22:31:27 UTC 
The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug.
Comment 13 pulp-infra@redhat.com 2016-12-02 16:01:28 UTC 
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.
Comment 14 Patricia Moeller 2017-09-06 11:39:37 UTC 
It seems as if the patch from mhrivnak never has landed in production Satellite.
Comment 15 Patricia Moeller 2017-09-06 11:42:38 UTC 
Sorry, found it.
Note You need to log in before you can comment on or make changes to this bug.