Bug 604724 - Urlgrabber command line program can't download certain urls, plus some other bugs
Summary: Urlgrabber command line program can't download certain urls, plus some other ...
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: python-urlgrabber
Version: 6.0
Hardware: All
OS: Linux
Target Milestone: rc
: ---
Assignee: James Antill
QA Contact: Petr Šplíchal
Keywords: Regression
Depends On:
Blocks: 519903 580448 609517
TreeView+ depends on / blocked
Reported: 2010-06-16 15:17 UTC by Petr Šplíchal
Modified: 2014-01-21 06:18 UTC (History)
2 users (show)

Clone Of:
Last Closed: 2010-11-10 21:23:44 UTC

Attachments (Terms of Use)

Description Petr Šplíchal 2010-06-16 15:17:43 UTC
Description of problem:

I was trying to download a file with the command line tool
urlgrabber with no success:

# rpm -q python-urlgrabber
# mkdir /tmp/urlgrabber
# cd /tmp/urlgrabber/
# urlgrabber http://www.redhat.com/
# echo $?
# ls -l
total 0
# urlgrabber -o file.html http://www.redhat.com/
ERROR: cannot use -o when grabbing multiple files
# urlgrabber http://www.redhat.com/ file.html
[Errno 2] Local file does not exist: /tmp/urlgrabber/file.html
# ls -l
total 0

The tool works fine in RHEL5, although with a different syntax:
# rpm -q python-urlgrabber
# urlgrabber http://www.redhat.com/ file.html
file written to file.html
# ls -l
total 24
-rw-r--r-- 1 root root 19900 Jun 16 11:14 file.html

Comment 3 James Antill 2010-07-01 15:18:13 UTC
There appears to be a couple of bugs here:

1. automatic filenames are broken for directories (eg. http://www.redhat.com/) it picks '' as the filename. You can still use: http://www.redhat.com/index.html.

2. Arg. checking for using -o with multiple args. is broken, -o X Y is counted as two download urls.

3. There's no long option for outputfile name.

4. urlgrabber tracebacks if you give it an option it doesn't recognize.

...I don't mind fixing all of them for 6.0, it's just I'm not sure how important they are testing functionality like:

urlgrabber -p http://download.fedora.redhat.com/pub/fedora/linux/releases/13/Everything/i386/os/repodata/1bc00e0f693f21eea9cdf0837f78ad1ae04a1fab991e42103f98abd74d2b7d66-comps-f13.xml.gz

...works fine.

Comment 7 releng-rhel@redhat.com 2010-11-10 21:23:44 UTC
Red Hat Enterprise Linux 6.0 is now available and should resolve
the problem described in this bug report. This report is therefore being closed
with a resolution of CURRENTRELEASE. You may reopen this bug report if the
solution does not work for you.

Note You need to log in before you can comment on or make changes to this bug.