Bug 604724 - Urlgrabber command line program can't download certain urls, plus some other bugs
Urlgrabber command line program can't download certain urls, plus some other ...
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: python-urlgrabber (Show other bugs)
All Linux
high Severity high
: rc
: ---
Assigned To: James Antill
Petr Šplíchal
: Regression
Depends On:
Blocks: 519903 580448 609517
  Show dependency treegraph
Reported: 2010-06-16 11:17 EDT by Petr Šplíchal
Modified: 2014-01-21 01:18 EST (History)
2 users (show)

See Also:
Fixed In Version: python-urlgrabber-3.9.1-7.el6
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Last Closed: 2010-11-10 16:23:44 EST
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)

  None (edit)
Description Petr Šplíchal 2010-06-16 11:17:43 EDT
Description of problem:

I was trying to download a file with the command line tool
urlgrabber with no success:

# rpm -q python-urlgrabber
# mkdir /tmp/urlgrabber
# cd /tmp/urlgrabber/
# urlgrabber http://www.redhat.com/
# echo $?
# ls -l
total 0
# urlgrabber -o file.html http://www.redhat.com/
ERROR: cannot use -o when grabbing multiple files
# urlgrabber http://www.redhat.com/ file.html
[Errno 2] Local file does not exist: /tmp/urlgrabber/file.html
# ls -l
total 0

The tool works fine in RHEL5, although with a different syntax:
# rpm -q python-urlgrabber
# urlgrabber http://www.redhat.com/ file.html
file written to file.html
# ls -l
total 24
-rw-r--r-- 1 root root 19900 Jun 16 11:14 file.html
Comment 3 James Antill 2010-07-01 11:18:13 EDT
There appears to be a couple of bugs here:

1. automatic filenames are broken for directories (eg. http://www.redhat.com/) it picks '' as the filename. You can still use: http://www.redhat.com/index.html.

2. Arg. checking for using -o with multiple args. is broken, -o X Y is counted as two download urls.

3. There's no long option for outputfile name.

4. urlgrabber tracebacks if you give it an option it doesn't recognize.

...I don't mind fixing all of them for 6.0, it's just I'm not sure how important they are testing functionality like:

urlgrabber -p http://download.fedora.redhat.com/pub/fedora/linux/releases/13/Everything/i386/os/repodata/1bc00e0f693f21eea9cdf0837f78ad1ae04a1fab991e42103f98abd74d2b7d66-comps-f13.xml.gz

...works fine.
Comment 7 releng-rhel@redhat.com 2010-11-10 16:23:44 EST
Red Hat Enterprise Linux 6.0 is now available and should resolve
the problem described in this bug report. This report is therefore being closed
with a resolution of CURRENTRELEASE. You may reopen this bug report if the
solution does not work for you.

Note You need to log in before you can comment on or make changes to this bug.