Bug 1395777

Summary: Pulp spend long time just to check metadata and say *nothing new* or to download a few packages
Product: Red Hat Satellite Reporter: Waldirio M Pinheiro <wpinheir>
Component: PulpAssignee: satellite6-bugs <satellite6-bugs>
Status: CLOSED ERRATA QA Contact: jcallaha
Severity: high Docs Contact:
Priority: medium    
Version: 6.2.4CC: abalakht, bbuckingham, bkearney, bmbouter, daviddavis, dkliban, ggainey, ipanova, jcallaha, jentrena, jomitsch, mhrivnak, pcreech, pdwyer, rchan, sauchter, ttereshc, unwosu, xdmoon, zhunting
Target Milestone: UnspecifiedKeywords: PrioBumpGSS, Triaged
Target Release: Unused   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: pulp-rpm-2.8.7.7-1 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1417110 (view as bug list) Environment:
Last Closed: 2017-03-06 08:34:49 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1388296, 1417110    
Attachments:
Description Flags
Sync Result Messages
none
Satellite Server November Usage
none
verification screenshot none

Description Waldirio M Pinheiro 2016-11-16 16:06:47 UTC
Description of problem:
Customer inform their satellite spend long time to sync all repos on their environment using syncplan, once they have 5 orgs and some locations, customer prefer create his own script and after this, got the same behavior on his script syncing via hammer.

Version-Release number of selected component (if applicable):
6.2.4

How reproducible:
100%

Steps to Reproduce:
1. Enable one repo (red hat enterprise linux 7.2 for example)
2. Sync repo
3. Follow via tasks

At the first time, we expect spend large time, Satellite will download ~14GB, at the second time, there isn't new packages to download or just a few packages, so this process should be faster *~2 min or less*, so customer face 5 min, 10 min, 1h just to say *no new packages* or download like 3 new packages

Actual results:
Pulp spend long time to conclude the sync process

Expected results:
if no new packages, get out faster, if new packages, download and just conclude and not stay processing during a long time after conclude the package files *rpm*

Additional info:

Comment 2 Eric Helms 2016-11-21 21:02:57 UTC
There is an upstream Pulp thread I've started to gather more information related to what I believe is this various from since I encountered it myself. [1] I think the crux of the issue relies around something happening with the 'Purge Duplicates' step that occurs during a sync. I'll report more information related to this as I get any.


[1] https://www.redhat.com/archives/pulp-list/2016-November/msg00030.html

Comment 7 Waldirio M Pinheiro 2016-11-25 00:58:57 UTC
Created attachment 1224100 [details]
Sync Result Messages

Comment 13 Waldirio M Pinheiro 2016-11-30 03:03:55 UTC
Created attachment 1226099 [details]
Satellite Server November Usage

Comment 14 pulp-infra@redhat.com 2016-12-01 19:01:22 UTC
The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.

Comment 15 pulp-infra@redhat.com 2016-12-01 19:01:26 UTC
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.

Comment 16 pulp-infra@redhat.com 2016-12-02 19:01:15 UTC
The Pulp upstream bug priority is at High. Updating the external tracker on this bug.

Comment 17 pulp-infra@redhat.com 2016-12-04 01:31:17 UTC
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.

Comment 18 pulp-infra@redhat.com 2016-12-04 02:01:19 UTC
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.

Comment 19 pulp-infra@redhat.com 2016-12-04 02:01:22 UTC
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.

Comment 20 pulp-infra@redhat.com 2016-12-06 18:01:08 UTC
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.

Comment 21 pulp-infra@redhat.com 2016-12-06 18:01:12 UTC
All upstream Pulp bugs are at MODIFIED+. Moving this bug to POST.

Comment 22 pulp-infra@redhat.com 2016-12-06 21:30:57 UTC
All upstream Pulp bugs are at MODIFIED+. Moving this bug to POST.

Comment 23 pulp-infra@redhat.com 2016-12-07 17:01:13 UTC
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.

Comment 28 pulp-infra@redhat.com 2017-01-10 02:01:46 UTC
The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug.

Comment 29 pulp-infra@redhat.com 2017-01-10 02:01:51 UTC
The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug.

Comment 30 pulp-infra@redhat.com 2017-01-16 21:02:02 UTC
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.

Comment 31 pulp-infra@redhat.com 2017-01-16 21:02:07 UTC
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.

Comment 33 jcallaha 2017-02-13 21:20:18 UTC
Verified in Satellite 6.2.8 Snap 2. Sync times are now significantly reduced, when there are no new packages to pull in. See attached for verification.

Comment 34 jcallaha 2017-02-13 21:21:05 UTC
Created attachment 1250029 [details]
verification screenshot

Comment 39 errata-xmlrpc 2017-03-06 08:34:49 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:0447