Bug 1442073 - Syncing puppet repositories from Satellite to Capsule takes hours even if no content changes
Summary: Syncing puppet repositories from Satellite to Capsule takes hours even if no ...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Capsule - Content
Version: 6.2.9
Hardware: All
OS: Linux
high
high
Target Milestone: Unspecified
Assignee: John Mitsch
QA Contact: Jitendra Yejare
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2017-04-13 12:47 UTC by Julio Entrena Perez
Modified: 2021-06-10 12:11 UTC (History)
12 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2018-02-21 16:54:37 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
dynflow console for capsule sync task (1.33 MB, text/html)
2017-04-13 12:47 UTC, Julio Entrena Perez
no flags Details
[Verification] Screenshot1 Attached - Optimized Capsule Sync (78.77 KB, image/png)
2018-01-10 12:29 UTC, Jitendra Yejare
no flags Details
[Verification] Screenshot2 Attached - Complete Capsule Sync (93.08 KB, image/png)
2018-01-10 12:29 UTC, Jitendra Yejare
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Foreman Issue Tracker 19267 0 Normal New skip metadata generation for all other content types aside from rpms when the content hasn't changed in a CVV promote/pu... 2020-12-03 17:17:22 UTC
Red Hat Bugzilla 1388296 0 high CLOSED Regression: Syncing large Library of content from Satellite to Capsule takes hours even if no content changes 2021-06-10 11:37:22 UTC
Red Hat Bugzilla 1419128 0 medium CLOSED Capsule sync in 6.2 is slower than in 6.1 2021-04-06 17:53:43 UTC

Internal Links: 1388296 1419128

Description Julio Entrena Perez 2017-04-13 12:47:57 UTC
Created attachment 1271429 [details]
dynflow console for capsule sync task

Description of problem:
This is the continuation of bug 1388296 for Puppet content.
Bug 1388296 addresses the problem for RPM content, this bug is for the same issue with Puppet content.

Version-Release number of selected component (if applicable):
tfm-rubygem-katello-3.0.0.105-2.BZ1388296.el7sat (Satellite 6.2.8 + hotfix from https://bugzilla.redhat.com/show_bug.cgi?id=1388296#c50 with the fix for bug 1388296).

How reproducible:
Always

Steps to Reproduce:
1. Run a Capsule sync when all repositories are already in sync.
2.
3.

Actual results:
All RPM repositories sync in a short amount of time.
Puppet repositories take much longer (more than 5,000 seconds).

Expected results:
Puppet repositories that are already in sync don't take large amounts of time to synchronise to the Capsules.

Additional info:
Check step 216 in attached dynflow console html page for a Capsule sync task.
All repos complete quickly but the Puppet repo in step 216 that, despite being already in sync, still took 5264 seconds.

Comment 1 John Mitsch 2017-04-13 12:51:26 UTC
Connecting redmine issue http://projects.theforeman.org/issues/19267 from this bug

Comment 6 John Mitsch 2017-09-07 17:37:19 UTC
Yes, https://bugzilla.redhat.com/show_bug.cgi?id=1388296#c57 is just for rpm repositories

Comment 17 Jitendra Yejare 2018-01-10 12:26:47 UTC
Verified!

@ Satellite 6.3 snap 30

Steps:

Re-run a Capsule sync when all repositories including puppet are already in sync.

Environment:

1. The capsule was set to On_Demand mode.
2. Tested in both capsule sync modes 'optimized sync' and 'complete sync'.
3. The test was conducted on 'OpenStack' puppet module.

Observation:
1. Puppet repositories which are already in sync didn't take a large time to sync. They were very quick.
2. I also see this in sync dynflow logs(complete capsule sync mode only):

    id: 5a55f9e9f42bed8334f9ea52
    details: 'Skipped: Repository content has not changed since last publish.'

3. In optimized sync mode, 'puppet repo' sync took just 2.37 seconds.
4. In Complete sync mode, 'puppet repo' sync took just 2.50 seconds

Screenshots are attached.

Comment 18 Jitendra Yejare 2018-01-10 12:29:00 UTC
Created attachment 1379495 [details]
[Verification] Screenshot1 Attached - Optimized Capsule Sync

Comment 19 Jitendra Yejare 2018-01-10 12:29:57 UTC
Created attachment 1379496 [details]
[Verification] Screenshot2 Attached - Complete Capsule Sync

Comment 20 Jitendra Yejare 2018-01-10 12:30:56 UTC
Please feel free to reopen if steps, environment or the observation is incorrect.

Comment 21 Satellite Program 2018-02-21 16:54:37 UTC
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA.
> > 
> > For information on the advisory, and where to find the updated files, follow the link below.
> > 
> > If the solution does not work for you, open a new bug report.
> > 
> > https://access.redhat.com/errata/RHSA-2018:0336


Note You need to log in before you can comment on or make changes to this bug.