Bug 1329051

Summary: Unable to sync Atomic content from Red Hat CDN
Product: Red Hat Satellite Reporter: Mike McCune <mmccune>
Component: PulpAssignee: satellite6-bugs <satellite6-bugs>
Status: CLOSED ERRATA QA Contact: Sachin Ghai <sghai>
Severity: high Docs Contact:
Priority: unspecified    
Version: 6.2.0CC: adahms, bbuckingham, bkearney, cwelton, ehelms, jortel, mcorr, mhrivnak, mmccune, nperic, paji
Target Milestone: UnspecifiedKeywords: Triaged
Target Release: Unused   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Enhancement
Doc Text:
Previously, users had to synchronize the Atomic Kickstart Tree content manually through a custom repository. With this release, users can synchronize the Atomic Kickstart Tree content from within the Red Hat Content Delivery Network.
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-10-26 12:26:03 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1342168    
Bug Blocks: 1321771    
Attachments:
Description Flags
synced ostree contents from CDN via webUI
none
ostree sync is on going from last 38 minutes
none
Screenshot of endless sync in Sat6 snap 12.1
none
sync completed for ostree contents in 6 minutes none

Description Mike McCune 2016-04-21 03:17:18 UTC
1) enable and synchronize the "Red Hat Enterprise Linux Atomic Host Trees" repository to Satellite 6.2

2) note that the sync never finishes, running 30-60 minutes without changing

manual syncs of similar sized repos take 3-10 minutes.

3) No recourse except to cancel task.


URL to feed is:

 https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo

Comment 1 Partha Aji 2016-04-21 03:28:15 UTC
I tried the following on the same box -> after I copied the correct key, client cert and cacert  to /tmp

1) 
mkdir /root/el7 && ostree init --repo /root/el7

2) ostree remote add --set=tls-client-cert-path=/tmp/cert --set=tls-client-key-path=/tmp/key --set=tls-ca-path=/tmp/cacert --repo /root/el7 --set=tls-permissive=true --set=gpg-verify=false el7 https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo rhel-atomic-host/7/x86_64/standard

3) 
sudo ostree pull el7 --repo /root/el7

1418 metadata, 13612 content objects fetched; 355536 KiB transferred in 331 seconds

Comment 3 Michael Hrivnak 2016-04-21 13:30:31 UTC
Do you have pulp's log output? Or the contents of the pulp task status?

Comment 4 Jeff Ortel 2016-04-21 14:12:03 UTC
Partha, please email me the certificates and key you used and I will reproduce/investigate.

Comment 5 Jeff Ortel 2016-04-22 01:52:32 UTC
(In reply to Partha Aji from comment #1)
> I tried the following on the same box -> after I copied the correct key,
> client cert and cacert  to /tmp
> 
> 1) 
> mkdir /root/el7 && ostree init --repo /root/el7
> 
> 2) ostree remote add --set=tls-client-cert-path=/tmp/cert
> --set=tls-client-key-path=/tmp/key --set=tls-ca-path=/tmp/cacert --repo
> /root/el7 --set=tls-permissive=true --set=gpg-verify=false el7
> https://cdn.redhat.com/content/dist/rhel/atomic/7/7Server/x86_64/ostree/repo
> rhel-atomic-host/7/x86_64/standard
> 
> 3) 
> sudo ostree pull el7 --repo /root/el7
> 
> 1418 metadata, 13612 content objects fetched; 355536 KiB transferred in 331
> seconds

Tried this ^ in Pulp and finished in ~2 minutes with no errors.

Comment 6 Sachin Ghai 2016-05-13 09:46:31 UTC
Yeah, I've synced the ostree repo from CDN with rhel6.2 GA snap10 and it was successfully synced without any issue and as per UI it took around 10-12 minutes.

Comment 7 Sachin Ghai 2016-05-13 09:47:10 UTC
Created attachment 1157057 [details]
synced ostree contents from CDN via webUI

Comment 8 Sachin Ghai 2016-05-23 12:52:07 UTC
This issue still persist. Its reproducible with snap12.1. I installed fresh setup on rhel7 w/ snap12.1 and sync is running from last 38 minutes.. I've synced rhel7 contents from CDN within that time frame.

Comment 9 Sachin Ghai 2016-05-23 12:53:01 UTC
Created attachment 1160611 [details]
ostree sync is on going from last 38 minutes

Comment 10 Sachin Ghai 2016-05-23 12:56:23 UTC
Another observation is: 

I was able to sync ostree contents from CDN in snap11. Later, I upgraded the satellite from snap11 -> sanp12.1 and re-sync the same repo and it failed with below error. I've filed separate bz 1338632 for this.

2016-05-23 03:29:08 [foreman-tasks/action] [E] OST0005: Fetch summary failed. Reason: GLib.Error('Server returned status 403: Forbidden', 'g-io-error-quark', 0) (Katello::Errors::PulpError)

Comment 11 Nenad Peric 2016-05-25 08:25:15 UTC
Created attachment 1161345 [details]
Screenshot of endless sync in Sat6 snap 12.1

Both in snap 12 and 12.1 the OSTree is syncing forever. 
It is stuck in sync for 18+ hours.

Will attach a screenshot.


Satellite rpm: 
satellite-6.2.0-12.1.el7sat.noarch

Comment 23 Partha Aji 2016-07-13 15:48:21 UTC
This should now work with updates from https://bugzilla.redhat.com/show_bug.cgi?id=1330753

Comment 24 Sachin Ghai 2016-10-13 10:20:20 UTC
Verified with sat6.2.3.

I synced Red Hat Atomic Hosts ostree contents from CDN and sync completed in 6 minutes. Please see the attached screenshot for verification.

Comment 25 Sachin Ghai 2016-10-13 10:23:40 UTC
Created attachment 1210000 [details]
sync completed for ostree contents in 6 minutes

Comment 27 errata-xmlrpc 2016-10-26 12:26:03 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:2108

Comment 28 Andrew Dahms 2017-10-05 00:38:12 UTC
Updated 'Doc Type'.