Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1329051 - Unable to sync Atomic content from Red Hat CDN
Unable to sync Atomic content from Red Hat CDN
Status: CLOSED ERRATA
Product: Red Hat Satellite 6
Classification: Red Hat
Component: Pulp (Show other bugs)
6.2.0
Unspecified Unspecified
unspecified Severity high (vote)
: 6.2.3
: Unused
Assigned To: satellite6-bugs
Sachin Ghai
: Triaged
Depends On: 1342168
Blocks: 1321771
  Show dependency treegraph
 
Reported: 2016-04-20 23:17 EDT by Mike McCune
Modified: 2017-10-25 18:49 EDT (History)
11 users (show)

See Also:
Fixed In Version:
Doc Type: Enhancement
Doc Text:
Previously, users had to synchronize the Atomic Kickstart Tree content manually through a custom repository. With this release, users can synchronize the Atomic Kickstart Tree content from within the Red Hat Content Delivery Network.
Story Points: ---
Clone Of:
Environment:
Last Closed: 2016-10-26 08:26:03 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)
synced ostree contents from CDN via webUI (26.56 KB, image/png)
2016-05-13 05:47 EDT, Sachin Ghai
no flags Details
ostree sync is on going from last 38 minutes (34.88 KB, image/png)
2016-05-23 08:53 EDT, Sachin Ghai
no flags Details
Screenshot of endless sync in Sat6 snap 12.1 (150.26 KB, image/png)
2016-05-25 04:25 EDT, Nenad Peric
no flags Details
sync completed for ostree contents in 6 minutes (39.28 KB, image/png)
2016-10-13 06:23 EDT, Sachin Ghai
no flags Details


External Trackers
Tracker ID Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2016:2108 normal SHIPPED_LIVE Satellite 6.2.3 Async Bug Release 2016-10-26 12:21:52 EDT

  None (edit)
Description Mike McCune 2016-04-20 23:17:18 EDT
1) enable and synchronize the "Red Hat Enterprise Linux Atomic Host Trees" repository to Satellite 6.2

2) note that the sync never finishes, running 30-60 minutes without changing

manual syncs of similar sized repos take 3-10 minutes.

3) No recourse except to cancel task.


URL to feed is:

 https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo
Comment 1 Partha Aji 2016-04-20 23:28:15 EDT
I tried the following on the same box -> after I copied the correct key, client cert and cacert  to /tmp

1) 
mkdir /root/el7 && ostree init --repo /root/el7

2) ostree remote add --set=tls-client-cert-path=/tmp/cert --set=tls-client-key-path=/tmp/key --set=tls-ca-path=/tmp/cacert --repo /root/el7 --set=tls-permissive=true --set=gpg-verify=false el7 https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo rhel-atomic-host/7/x86_64/standard

3) 
sudo ostree pull el7 --repo /root/el7

1418 metadata, 13612 content objects fetched; 355536 KiB transferred in 331 seconds
Comment 3 Michael Hrivnak 2016-04-21 09:30:31 EDT
Do you have pulp's log output? Or the contents of the pulp task status?
Comment 4 Jeff Ortel 2016-04-21 10:12:03 EDT
Partha, please email me the certificates and key you used and I will reproduce/investigate.
Comment 5 Jeff Ortel 2016-04-21 21:52:32 EDT
(In reply to Partha Aji from comment #1)
> I tried the following on the same box -> after I copied the correct key,
> client cert and cacert  to /tmp
> 
> 1) 
> mkdir /root/el7 && ostree init --repo /root/el7
> 
> 2) ostree remote add --set=tls-client-cert-path=/tmp/cert
> --set=tls-client-key-path=/tmp/key --set=tls-ca-path=/tmp/cacert --repo
> /root/el7 --set=tls-permissive=true --set=gpg-verify=false el7
> https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo
> rhel-atomic-host/7/x86_64/standard
> 
> 3) 
> sudo ostree pull el7 --repo /root/el7
> 
> 1418 metadata, 13612 content objects fetched; 355536 KiB transferred in 331
> seconds

Tried this ^ in Pulp and finished in ~2 minutes with no errors.
Comment 6 Sachin Ghai 2016-05-13 05:46:31 EDT
Yeah, I've synced the ostree repo from CDN with rhel6.2 GA snap10 and it was successfully synced without any issue and as per UI it took around 10-12 minutes.
Comment 7 Sachin Ghai 2016-05-13 05:47 EDT
Created attachment 1157057 [details]
synced ostree contents from CDN via webUI
Comment 8 Sachin Ghai 2016-05-23 08:52:07 EDT
This issue still persist. Its reproducible with snap12.1. I installed fresh setup on rhel7 w/ snap12.1 and sync is running from last 38 minutes.. I've synced rhel7 contents from CDN within that time frame.
Comment 9 Sachin Ghai 2016-05-23 08:53 EDT
Created attachment 1160611 [details]
ostree sync is on going from last 38 minutes
Comment 10 Sachin Ghai 2016-05-23 08:56:23 EDT
Another observation is: 

I was able to sync ostree contents from CDN in snap11. Later, I upgraded the satellite from snap11 -> sanp12.1 and re-sync the same repo and it failed with below error. I've filed separate bz 1338632 for this.

2016-05-23 03:29:08 [foreman-tasks/action] [E] OST0005: Fetch summary failed. Reason: GLib.Error('Server returned status 403: Forbidden', 'g-io-error-quark', 0) (Katello::Errors::PulpError)
Comment 11 Nenad Peric 2016-05-25 04:25 EDT
Created attachment 1161345 [details]
Screenshot of endless sync in Sat6 snap 12.1

Both in snap 12 and 12.1 the OSTree is syncing forever. 
It is stuck in sync for 18+ hours.

Will attach a screenshot.


Satellite rpm: 
satellite-6.2.0-12.1.el7sat.noarch
Comment 23 Partha Aji 2016-07-13 11:48:21 EDT
This should now work with updates from https://bugzilla.redhat.com/show_bug.cgi?id=1330753
Comment 24 Sachin Ghai 2016-10-13 06:20:20 EDT
Verified with sat6.2.3.

I synced Red Hat Atomic Hosts ostree contents from CDN and sync completed in 6 minutes. Please see the attached screenshot for verification.
Comment 25 Sachin Ghai 2016-10-13 06:23 EDT
Created attachment 1210000 [details]
sync completed for ostree contents in 6 minutes
Comment 27 errata-xmlrpc 2016-10-26 08:26:03 EDT
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:2108
Comment 28 Andrew Dahms 2017-10-04 20:38:12 EDT
Updated 'Doc Type'.

Note You need to log in before you can comment on or make changes to this bug.