Bug 1121296 - repysync fails to clone EPEL 7
Summary: repysync fails to clone EPEL 7
Keywords:
Status: ASSIGNED
Alias: None
Product: Fedora EPEL
Classification: Fedora
Component: epel-release
Version: epel7
Hardware: x86_64
OS: Linux
unspecified
medium
Target Milestone: ---
Assignee: Kevin Fenzi
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-07-18 23:19 UTC by Brandon Ess
Modified: 2014-10-11 04:01 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:


Attachments (Terms of Use)

Description Brandon Ess 2014-07-18 23:19:06 UTC
Description of problem:

reposync fails to clone/download EPEL7 on RHEL7. It fails with a Python error.

Version-Release number of selected component (if applicable):

yum-utils-1.1.31-24.el7

How reproducible:

Use reposync to download EPEL7 to a local mirror

Steps to Reproduce:
1. /usr/bin/reposync -p /mnt/rhel-repo/linux-repos/rhel/7/x86_64 --repoid=epel

Actual results:

[root@rhel7-repo x86_64]# /usr/bin/reposync -p /mnt/rhel-repo/linux-repos/rhel/7/x86_64 --repoid=epel
(1/4761): 3proxy-sysvinit-0.7-1.el7.x86_64.rpm                                                                              | 8.3 kB  00:00:00     
(2/4761): Agda-2.3.2.2-3.el7.x86_64.rpm                                                                                     | 6.6 kB  00:00:00     
(3/4761): BareBonesBrowserLaunch-javadoc-3.1-7.el7.noarch.rpm                                                               |  13 kB  00:00:00     
(4/4761): BareBonesBrowserLaunch-3.1-7.el7.noarch.rpm                                                                       |  23 kB  00:00:00     
(5/4761): CGSI-gSOAP-1.3.6-6.el7.x86_64.rpm                                                                                 |  44 kB  00:00:00     
(6/4761): CGSI-gSOAP-devel-1.3.6-6.el7.x86_64.rpm                                                                           |  75 kB  00:00:00     
(7/4761): CUnit-2.1.3-8.el7.x86_64.rpm                                                                                      |  48 kB  00:00:00     
(8/4761): 3proxy-0.7-1.el7.x86_64.rpm                                                                                       | 170 kB  00:00:01     
(9/4761): CharLS-devel-1.0-5.el7.x86_64.rpm                                                                                 |  22 kB  00:00:00     
(10/4761): CharLS-1.0-5.el7.x86_64.rpm                                                                                      |  63 kB  00:00:00     
(11/4761): CUnit-devel-2.1.3-8.el7.x86_64.rpm                                                                               |  61 kB  00:00:00     
(12/4761): ColPack-cli-1.0.9-3.el7.x86_64.rpm                                                                               |  12 kB  00:00:00     
Traceback (most recent call last):
  File "/usr/libexec/urlgrabber-ext-down", line 75, in <module>
    main()
  File "/usr/libexec/urlgrabber-ext-down", line 61, in main
    fo = PyCurlFileObject(opts.url, opts.filename, opts)
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1258, in __init__
    self._do_open()
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1589, in _do_open
    self._do_grab()
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1723, in _do_grab
    self._do_perform()
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1517, in _do_perform
    raise KeyboardInterrupt
KeyboardInterrupt
Traceback (most recent call last):
  File "/usr/bin/reposync", line 337, in <module>
    main()
  File "/usr/bin/reposync", line 311, in main
    probs = my.downloadPkgs(download_list)
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 2519, in downloadPkgs
    urlgrabber.grabber.parallel_wait()
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 2281, in parallel_wait
    perform()
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 2197, in perform
    for opts, size, ug_err in dl.perform():
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 2129, in perform
    raise KeyboardInterrupt
KeyboardInterrupt


Expected results:

[root@rhel7-repo x86_64]# /usr/bin/reposync -p /mnt/rhel-repo/linux-repos/rhel/7/x86_64 --repoid=rhel-7-server-extras-rpms
(1/12): docker-0.11.1-19.el7.x86_64.rpm                                                                                     | 4.4 MB  00:00:12     
(2/12): docker-registry-0.6.8-8.el7.noarch.rpm                                                                              | 124 kB  00:00:00     
(3/12): libev-4.15-4.el7.x86_64.rpm                                                                                         |  44 kB  00:00:00     
(4/12): python-backports-lzma-0.0.2-7.el7.x86_64.rpm                                                                        |  26 kB  00:00:00     
(5/12): python-blinker-1.3-2.el7.noarch.rpm                                                                                 |  93 kB  00:00:00     
(6/12): python-flask-0.10.1-4.el7.noarch.rpm                                                                                | 204 kB  00:00:01     
(7/12): docker-0.11.1-22.el7.x86_64.rpm                                                                                     | 4.4 MB  00:00:17     
(8/12): python-greenlet-0.4.2-3.el7.x86_64.rpm                                                                              |  26 kB  00:00:00     
(9/12): python-gevent-1.0-2.el7.x86_64.rpm                                                                                  | 273 kB  00:00:01     
(10/12): python-itsdangerous-0.23-2.el7.noarch.rpm                                                                          |  24 kB  00:00:00     
(11/12): python-gunicorn-18.0-2.el7.noarch.rpm                                                                              | 171 kB  00:00:01     
(12/12): python-werkzeug-0.9.1-2.el7.noarch.rpm  

Additional info:

this error only happens when mirroring EPEL, other RHEL 7 repos work just fine.

Comment 1 Brandon Ess 2014-07-18 23:34:43 UTC
It looks like the error is with the EPEL7.rpm package. It create a .repo file with the wrong baseurl:

baseurl=http://download.fedoraproject.org/pub/epel/7/$basearch

But that URL is not vaild and the packages are still in the EPEL7 beta directory.

baseurl=https://dl.fedoraproject.org/pub/epel/beta/7/x86_64/

After fixing that, reposync works as expected.

This is an EPEL7 bug, not a RHEL7 bug. Is this still the correct place to file a bug report?

Comment 3 Kevin Fenzi 2014-08-06 12:23:28 UTC
So, download.fedoraproject.org should be valid. That should point you to a random mirror for the thing you are looking for. 

Can you describe how you are seeing the url be invalid?


Note You need to log in before you can comment on or make changes to this bug.