Bug 1387314

Summary:	Errata applicability generate is taking a very long time
Product:	Red Hat Satellite	Reporter:	Brad Buckingham <bbuckingham>
Component:	Pulp	Assignee:	satellite6-bugs <satellite6-bugs>
Status:	CLOSED ERRATA	QA Contact:	jcallaha
Severity:	high	Docs Contact:
Priority:	high
Version:	6.2.2	CC:	abalakht, bkearney, bmbouter, daviddavis, dkliban, egolov, ggainey, inecas, ipanova, jcallaha, jokot3, ktordeur, mhrivnak, mmello, nkim, patricia.moeller, pcreech, pdwyer, pgagne, pmoravec, rchan, sthirugn, ttereshc, zhunting
Target Milestone:	Unspecified	Keywords:	Triaged
Target Release:	Unused
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	pulp-rpm-2.8.7.4-1	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:
Clones:	1389541 (view as bug list)		Environment:
Last Closed:	2016-11-10 08:14:37 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Bug Depends On:
Bug Blocks:	1389541

Description Brad Buckingham 2016-10-20 15:35:23 UTC

Description of problem:

It has been observed that applicability generation can take a very long time, potentially hours under certain conditions.

Investigation has been performed in the upstream and an issue created.  Creating this bugzilla to link it to the upstream issue and request inclusion of it in an upcoming release.

Comment 2 pulp-infra@redhat.com 2016-10-20 19:01:08 UTC

The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.

Comment 3 pulp-infra@redhat.com 2016-10-20 19:01:10 UTC

The Pulp upstream bug priority is at High. Updating the external tracker on this bug.

Comment 4 pulp-infra@redhat.com 2016-10-20 19:31:13 UTC

The Pulp upstream bug status is at POST. Updating the external tracker on this bug.

Comment 5 pulp-infra@redhat.com 2016-10-21 17:31:19 UTC

The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.

Comment 8 Marcelo Moreira de Mello 2016-10-25 23:04:32 UTC

*** Bug 1388694 has been marked as a duplicate of this bug. ***

Comment 9 jcallaha 2016-11-07 19:44:07 UTC

Verified in Satellite 6.2.4 Snap 2

errata applicability regeneration now takes 0.01s to 0.08s on a system with over 1,000 content hosts, each with approximately 150 applicable errata. See below output from /var/log/messages


Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[2ca3570d-2cfd-4e4e-9a05-d79c73a41d89] succeeded in 0.0422392729961s: None
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[757f44fd-2127-486b-a749-dc4e99efefd1]
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[757f44fd-2127-486b-a749-dc4e99efefd1] succeeded in 0.0402859799942s: None
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[12f833fb-66fd-4e7f-859b-6f7117d6d8c9]
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[12f833fb-66fd-4e7f-859b-6f7117d6d8c9] succeeded in 0.0592358709982s: None
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[328a682e-88e0-45ed-851c-e6da1b9b8845]
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[328a682e-88e0-45ed-851c-e6da1b9b8845] succeeded in 0.0405485439987s: None
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[cd3978eb-665d-4a53-8f34-9ef9b5558c1a]
Nov  7 14:07:40 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[cd3978eb-665d-4a53-8f34-9ef9b5558c1a] succeeded in 0.0464273560065s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[d18b054c-107b-4dc9-a0bc-1bec9eace0ed]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[d18b054c-107b-4dc9-a0bc-1bec9eace0ed] succeeded in 0.0129853700055s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[45cd5f59-ed87-44b9-9e4b-89292be4d62f]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[45cd5f59-ed87-44b9-9e4b-89292be4d62f] succeeded in 0.0404461589933s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[bbd648bd-8b53-43b7-807c-a897886973b2]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[bbd648bd-8b53-43b7-807c-a897886973b2] succeeded in 0.0126445479982s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[3e19427c-e088-4a39-88ac-a4374834c220]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[3e19427c-e088-4a39-88ac-a4374834c220] succeeded in 0.0147995179868s: None
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[1abd2905-b68a-47e3-b598-5bf6e5e2294f]
Nov  7 14:07:41 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[1abd2905-b68a-47e3-b598-5bf6e5e2294f] succeeded in 0.0126767230104s: None
Nov  7 14:07:42 intel-canoepass-11 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[ad08a361-c48a-44d4-90ea-57b11d4156f8]
Nov  7 14:07:42 intel-canoepass-11 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_consumers[ad08a361-c48a-44d4-90ea-57b11d4156f8] succeeded in 0.0132362349977s: None

Comment 11 errata-xmlrpc 2016-11-10 08:14:37 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:2699

Comment 12 pulp-infra@redhat.com 2016-11-21 22:31:27 UTC

The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug.

Comment 13 pulp-infra@redhat.com 2016-12-02 16:01:28 UTC

The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.

Comment 14 Patricia Moeller 2017-09-06 11:39:37 UTC

It seems as if the patch from mhrivnak never has landed in production Satellite.

Comment 15 Patricia Moeller 2017-09-06 11:42:38 UTC

Sorry, found it.