Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1329051 - Unable to sync Atomic content from Red Hat CDN
Summary: Unable to sync Atomic content from Red Hat CDN
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Pulp
Version: 6.2.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: Unspecified
Assignee: satellite6-bugs
QA Contact: Sachin Ghai
URL:
Whiteboard:
Depends On: 1342168
Blocks: 1321771
TreeView+ depends on / blocked
 
Reported: 2016-04-21 03:17 UTC by Mike McCune
Modified: 2019-09-26 17:34 UTC (History)
11 users (show)

Fixed In Version:
Doc Type: Enhancement
Doc Text:
Previously, users had to synchronize the Atomic Kickstart Tree content manually through a custom repository. With this release, users can synchronize the Atomic Kickstart Tree content from within the Red Hat Content Delivery Network.
Clone Of:
Environment:
Last Closed: 2016-10-26 12:26:03 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
synced ostree contents from CDN via webUI (26.56 KB, image/png)
2016-05-13 09:47 UTC, Sachin Ghai 		no flags Details
ostree sync is on going from last 38 minutes (34.88 KB, image/png)
2016-05-23 12:53 UTC, Sachin Ghai 		no flags Details
Screenshot of endless sync in Sat6 snap 12.1 (150.26 KB, image/png)
2016-05-25 08:25 UTC, Nenad Peric 		no flags Details
sync completed for ostree contents in 6 minutes (39.28 KB, image/png)
2016-10-13 10:23 UTC, Sachin Ghai 		no flags Details
View All


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2016:2108 0 normal SHIPPED_LIVE Satellite 6.2.3 Async Bug Release 2016-10-26 16:21:52 UTC

Description Mike McCune 2016-04-21 03:17:18 UTC 
1) enable and synchronize the "Red Hat Enterprise Linux Atomic Host Trees" repository to Satellite 6.2

2) note that the sync never finishes, running 30-60 minutes without changing

manual syncs of similar sized repos take 3-10 minutes.

3) No recourse except to cancel task.


URL to feed is:

 https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo
Comment 1 Partha Aji 2016-04-21 03:28:15 UTC 
I tried the following on the same box -> after I copied the correct key, client cert and cacert  to /tmp

1) 
mkdir /root/el7 && ostree init --repo /root/el7

2) ostree remote add --set=tls-client-cert-path=/tmp/cert --set=tls-client-key-path=/tmp/key --set=tls-ca-path=/tmp/cacert --repo /root/el7 --set=tls-permissive=true --set=gpg-verify=false el7 https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo rhel-atomic-host/7/x86_64/standard

3) 
sudo ostree pull el7 --repo /root/el7

1418 metadata, 13612 content objects fetched; 355536 KiB transferred in 331 seconds
Comment 3 Michael Hrivnak 2016-04-21 13:30:31 UTC 
Do you have pulp's log output? Or the contents of the pulp task status?
Comment 4 Jeff Ortel 2016-04-21 14:12:03 UTC 
Partha, please email me the certificates and key you used and I will reproduce/investigate.
Comment 5 Jeff Ortel 2016-04-22 01:52:32 UTC 
(In reply to Partha Aji from comment #1)
> I tried the following on the same box -> after I copied the correct key,
> client cert and cacert  to /tmp
> 
> 1) 
> mkdir /root/el7 && ostree init --repo /root/el7
> 
> 2) ostree remote add --set=tls-client-cert-path=/tmp/cert
> --set=tls-client-key-path=/tmp/key --set=tls-ca-path=/tmp/cacert --repo
> /root/el7 --set=tls-permissive=true --set=gpg-verify=false el7
> https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo
> rhel-atomic-host/7/x86_64/standard
> 
> 3) 
> sudo ostree pull el7 --repo /root/el7
> 
> 1418 metadata, 13612 content objects fetched; 355536 KiB transferred in 331
> seconds

Tried this ^ in Pulp and finished in ~2 minutes with no errors.
Comment 6 Sachin Ghai 2016-05-13 09:46:31 UTC 
Yeah, I've synced the ostree repo from CDN with rhel6.2 GA snap10 and it was successfully synced without any issue and as per UI it took around 10-12 minutes.
Comment 7 Sachin Ghai 2016-05-13 09:47:10 UTC 
Created attachment 1157057 [details]
synced ostree contents from CDN via webUI
Comment 8 Sachin Ghai 2016-05-23 12:52:07 UTC 
This issue still persist. Its reproducible with snap12.1. I installed fresh setup on rhel7 w/ snap12.1 and sync is running from last 38 minutes.. I've synced rhel7 contents from CDN within that time frame.
Comment 9 Sachin Ghai 2016-05-23 12:53:01 UTC 
Created attachment 1160611 [details]
ostree sync is on going from last 38 minutes
Comment 10 Sachin Ghai 2016-05-23 12:56:23 UTC 
Another observation is: 

I was able to sync ostree contents from CDN in snap11. Later, I upgraded the satellite from snap11 -> sanp12.1 and re-sync the same repo and it failed with below error. I've filed separate bz 1338632 for this.

2016-05-23 03:29:08 [foreman-tasks/action] [E] OST0005: Fetch summary failed. Reason: GLib.Error('Server returned status 403: Forbidden', 'g-io-error-quark', 0) (Katello::Errors::PulpError)
Comment 11 Nenad Peric 2016-05-25 08:25:15 UTC 
Created attachment 1161345 [details]
Screenshot of endless sync in Sat6 snap 12.1

Both in snap 12 and 12.1 the OSTree is syncing forever. 
It is stuck in sync for 18+ hours.

Will attach a screenshot.


Satellite rpm: 
satellite-6.2.0-12.1.el7sat.noarch
Comment 23 Partha Aji 2016-07-13 15:48:21 UTC 
This should now work with updates from https://bugzilla.redhat.com/show_bug.cgi?id=1330753
Comment 24 Sachin Ghai 2016-10-13 10:20:20 UTC 
Verified with sat6.2.3.

I synced Red Hat Atomic Hosts ostree contents from CDN and sync completed in 6 minutes. Please see the attached screenshot for verification.
Comment 25 Sachin Ghai 2016-10-13 10:23:40 UTC 
Created attachment 1210000 [details]
sync completed for ostree contents in 6 minutes
Comment 27 errata-xmlrpc 2016-10-26 12:26:03 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:2108
Comment 28 Andrew Dahms 2017-10-05 00:38:12 UTC 
Updated 'Doc Type'.
Note You need to log in before you can comment on or make changes to this bug.