Bug 1626797 - cdn-sync should be able to sync kickstarts/channel even if not all of its kickstart repos are available
Summary: cdn-sync should be able to sync kickstarts/channel even if not all of its kic...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite 5
Classification: Red Hat
Component: Satellite Synchronization
Version: 580
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
Assignee: Michael Mráka
QA Contact: Radovan Drazny
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-09-08 20:59 UTC by Jan Hutař
Modified: 2018-11-30 18:05 UTC (History)
3 users (show)

Fixed In Version: spacewalk-backend-2.5.3-171
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2018-11-30 18:05:12 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2018:3756 0 None None None 2018-11-30 18:05:28 UTC

Description Jan Hutař 2018-09-08 20:59:54 UTC
Description of problem:
cdn-sync should be able to sync kickstarts/channel even if not all of its kickstart repos are available


Version-Release number of selected component (if applicable):
Satellite 5.8


How reproducible:
always


Steps to Reproduce:
1. Attempt to sync from RHEL7 content ISO directory with only, say, RHEL 7.5 kickstart repo added to the directory tree


Actual results:
# cdn-sync -m /var/satellite/OUT-rhel7/ -c rhel-x86_64-server-7
15:18:56 ERROR: Channel 'rhel-x86_64-server-7' repositories are not available.
15:18:56 Total time: 0:00:00
ERROR: these channels either do not exist or are not available for synchronization:
  rhel-x86_64-server-7


Expected results:
# cdn-sync -m /var/satellite/OUT-rhel7/ -c rhel-x86_64-server-7
15:19:37 ======================================
15:19:37 | Channel: rhel-x86_64-server-7
15:19:37 ======================================
15:19:37 Sync of channel started.
[...]

Comment 3 Michael Mráka 2018-09-21 09:04:27 UTC
Fixed in spacewalk.git by

commit a9083643d2d435ed88e285cbd1b90a3d0c01d395
    1626797 - don't fail if kickstart is missing, just warn

Comment 4 Michael Mráka 2018-09-21 09:07:53 UTC
Output of fixed command:

# cdn-sync -m /root/data/ -c rhel-x86_64-server-7
04:42:38 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.0' is unavailable
04:42:38 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.1' is unavailable
04:42:38 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.2' is unavailable
04:42:38 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.3' is unavailable
04:42:38 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.5' is unavailable
04:42:38 ======================================
04:42:38 | Channel: rhel-x86_64-server-7
04:42:38 ======================================
04:42:38 Sync of channel started.
04:42:38 Repo URL: file:///root/data/content/dist/rhel/server/7/7Server/x86_64/os
04:43:26 Packages in repo:             20920
04:44:45 No new packages to sync.
04:44:45 Repo file:///root/data/content/dist/rhel/server/7/7Server/x86_64/os has comps file ae3b134ecf11ee4627ec9d50bd5cf51328c98c567dd860cd7a5da664df46ecb8-comps.xml.
04:44:47 Repo file:///root/data/content/dist/rhel/server/7/7Server/x86_64/os has 3085 errata.
04:44:47 No new errata to sync.
04:44:47 Kickstartable tree not detected (no valid treeinfo file)
04:44:47 Repo URL: file:///root/data/content/dist/rhel/server/7/7.4/x86_64/kickstart
04:44:48 Packages in repo:              4986
04:45:07 No new packages to sync.
04:45:07 Repo file:///root/data/content/dist/rhel/server/7/7.4/x86_64/kickstart has comps file 9c36ffa7133f0a1d973e3f4a323fae9cdf9463d5a7eec37fbf3e3824ffd9c78c-comps-Server.x86_64.xml.gz.
04:45:07 Repo file:///root/data/content/dist/rhel/server/7/7.4/x86_64/kickstart has 0 errata.
04:45:07 Added new kickstartable tree ks-rhel-x86_64-server-7-7.4. Downloading content...
04:45:07 Gathering all files in kickstart repository...   
04:45:07 Downloading 79 kickstart files.
Downloading kickstarts: |##################################################| 100.0%
04:45:16 Sync of channel completed in 0:02:38.
04:45:16 Total time: 0:02:38

Comment 5 Michael Mráka 2018-09-21 10:04:27 UTC
Additional fix for build time failure

commit 007ad22fd0980acfe965b7abf97ae9c37751640c
    1626797 - fixed line-too-long (build time failure)

Comment 7 Michael Mráka 2018-10-05 13:21:39 UTC
Satellite fix:

commit f42f0b3c5f8982c5211cf5cf520d70713fcb1bf9
    1626797 - fixed line-too-long (build time failure)
commit 82ce0fddce3a04ef925094354cd48e75eabf2216
    1626797 - don't fail if kickstart is missing, just warn

Comment 8 Radovan Drazny 2018-10-15 19:00:12 UTC
Verified on spacewalk-backend-2.5.3-171.el6sat. 

I have created a local CDN mirror and RHEL 7.x installation isos (RHEL 7.5 and RHEL 7.3) as described in https://access.redhat.com/articles/1375133. Running the cdn-sync succesfully synced the rhel-x86_64-server-7 channel even with other kickstarts missing, only printing the warning message: 

(Channel previously successfully synced with the RHEL 7.3 kickstart, RHEL 7.5 kickstart added before the current sync)

$ cdn-sync  -m . -c rhel-x86_64-server-7
14:51:49 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.0' is unavailable
14:51:49 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.1' is unavailable
14:51:49 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.2' is unavailable
14:51:49 WARNING: kickstart tree 'ks-rhel-x86_64-server-7-7.4' is unavailable
14:51:49 ======================================
14:51:49 | Channel: rhel-x86_64-server-7
14:51:49 ======================================
14:51:49 Sync of channel started.
14:51:49
14:51:49   Processing repository with URL: file:///root/dumps-sat6/extracted/content/dist/rhel/server/7/7Server/x86_64/os
14:52:26     Packages in repo:             20920
14:56:22     No new packages to sync.
14:56:22
14:56:22   Importing comps file ae3b134ecf11ee4627ec9d50bd5cf51328c98c567dd860cd7a5da664df46ecb8-comps.xml.
14:56:23
14:56:23   Errata in repo: 3085.
14:56:24     No new errata to sync.
14:56:24
14:56:24   Importing kickstarts.
14:56:24     Kickstartable tree not detected (no valid treeinfo file)
14:56:24
14:56:24   Processing repository with URL: file:///root/dumps-sat6/extracted/content/dist/rhel/server/7/7.3/x86_64/kickstart
14:56:25     Packages in repo:              4751
14:56:44     No new packages to sync.
14:56:44
14:56:44   Importing comps file c542e4cf37dd210de68877b53f41d92dc7686c6e1b35ca4b1852f2e62fca2c72-comps-Server.x86_64.xml.gz.
14:56:44
14:56:44   Errata in repo: 0.
14:56:44
14:56:44   Importing kickstarts.
14:56:44     Kickstartable tree ks-rhel-x86_64-server-7-7.3 already synced. Updating content...
14:56:44     Gathering all files in kickstart repository...
14:56:44 No new kickstart files to download.
14:56:44
14:56:44   Processing repository with URL: file:///root/dumps-sat6/extracted/content/dist/rhel/server/7/7.5/x86_64/kickstart
14:56:45     Packages in repo:              5099
14:57:05     No new packages to sync.
14:57:05
14:57:05   Importing comps file 2a2dc8f8a66f9c4d8b7a8ac2ec308594b97c344ec0810266cdf0795d9f77e965-comps-Server.x86_64.xml.gz.
14:57:05
14:57:05   Errata in repo: 0.
14:57:05
14:57:05   Importing kickstarts.
14:57:05     Added new kickstartable tree ks-rhel-x86_64-server-7-7.5. Downloading content...
14:57:05     Gathering all files in kickstart repository...
14:57:06     Downloading 177 kickstart files.
              Downloading kickstarts: |##################################################| 100.0%
14:57:19 Sync of channel completed in 0:05:29.
14:57:19 Total time: 0:05:29

Comment 10 errata-xmlrpc 2018-11-30 18:05:12 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:3756


Note You need to log in before you can comment on or make changes to this bug.