Bug 1323009

Summary:	Packages are fetched twice per repo during content view publish
Product:	Red Hat Satellite	Reporter:	Eric Helms <ehelms>
Component:	Performance	Assignee:	Justin Sherrill <jsherril>
Status:	CLOSED ERRATA	QA Contact:	Corey Welton <cwelton>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	6.0.4	CC:	bbuckingham, cduryee, cwelton, mmccune
Target Milestone:	Unspecified	Keywords:	Triaged
Target Release:	Unused
Hardware:	Unspecified
OS:	Unspecified
URL:	http://projects.theforeman.org/issues/14428
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2016-07-27 11:41:14 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Eric Helms 2016-04-01 00:16:06 UTC

During a content view publish, we fetch packages for errata and package groups to purge empty errata and empty package groups from the resulting repository and then at the end we index content. We could index the content from the new repository (i.e. after filters have been applied within Pulp to create the new repo) and then perform the purging by using the indexed content in our repository instead of going to Pulp for that data.

Comment 1 Eric Helms 2016-04-01 00:16:08 UTC

Created from redmine issue http://projects.theforeman.org/issues/14428

Comment 3 Mike McCune 2016-04-06 23:23:09 UTC

I have also noticed a performance degradation between 2.4 -> 3.0:

2.4:

Content View with 15000 Packages: 3 minute publish time

3.0:

Content View with 15000 Packages: 5 minute publish time

same hardware, no load

Comment 4 Bryan Kearney 2016-04-13 00:02:20 UTC

Upstream bug assigned to jsherril

Comment 5 Chris Duryee 2016-04-13 19:53:48 UTC

https://bugzilla.redhat.com/show_bug.cgi?id=1326941 created to address comment #3.

Comment 6 Bryan Kearney 2016-04-20 14:02:47 UTC

Moving to POST since upstream bug http://projects.theforeman.org/issues/14428 has been closed
-------------
Justin Sherrill
Applied in changeset commit:katello|c74960743169a7dc1410f2bcb3a3df0d6d5d230b.

Comment 7 Corey Welton 2016-05-24 20:43:37 UTC

Verified (I think) in SNAP 12.1

Published a CV with RHEL7+SCL (14000+ packages) and it took ~3 minutes.

In general, publish seems to be much more snappy than it has been in previous composes.

Comment 8 Bryan Kearney 2016-07-27 11:41:14 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1501