Thanks for the report!  Seems /var/cache/yum/timedhosts file got malformed somehow (empty line, less than 4 values on some line etc).  Could you attach it, please?  It's probably an easy fix, but I'd like to know the root cause, before just ignoring such lines when reading mirror speed info.

Created attachment 585358 [details]
timerhosts.txt

Created attachment 585359 [details]
timedhosts

Also found this in same dir, removing this no difference to traceback.

Thanks!

' 22165 0 1337268949' is the problem, the "hostname" field is empty.  Curiously enough the mirror does not seem to be failing.

You probably have some bogus baseurl set up in some repo, eg http:///foo.org (note 3 slashes), but it might also come from some mirrorlist, can't tell.
Could be a bug in urlparse module, too.  I'll add a sanity check for this.

You might want to run Yum again with "export URLGRABBER_DEBUG=1,debug.txt", and check URLs in debug.txt, or attach the log to the BZ.

(In reply to comment #4)
> Thanks!

> 
> You probably have some bogus baseurl set up in some repo, eg http:///foo.org
> (note 3 slashes), but it might also come from some mirrorlist, can't tell.
> Could be a bug in urlparse module, too.  I'll add a sanity check for this.

Check /etc/yum.repos.d/*.repo
no /// in any.

> 
> You might want to run Yum again with "export URLGRABBER_DEBUG=1,debug.txt", and
> check URLs in debug.txt, or attach the log to the BZ.

Where do I place this exactly tried:
"yum update export URLGRABBER_DEBUG=1,debug.txt"
or does it go in /etc/yum.conf

but cannot find debug.txt, even after updatedb

Hi,

"URLGRABBER_DEBUG=1,debug.txt yum update" should work.  Also, you will have to "rm /var/cache/yum/timedhosts", otherwise Yum will crash early.

Created attachment 585387 [details]
URLGRABBER_DEBUG=1,debug.txt yum update

Got the cause of the problem,
Cache for all Fedora release is ketp at:
cachedir=/nfs/yum/$releasever/$basearch
(saves online bandwidth)

Somehow the rawhide ba was pulling timeshosts from:
/nfs/yum/18/i386/timedhosts*

instead of:
/nfs/yum/rawhide/i386
which has no timedhosts* as I deleted them before running dubug.

This bug  be particular to my setup.
though local.conf, yum.conf, _local.repo are set correctly for rawhide.

I've managed to reproduce this myself.  It's the 'file://' URL handling..  These are normally handled immediately and NOT profiled, except for when such URLs are inside a mirrorlist (then we crash).  There's a quick fix:

--- a/urlgrabber/grabber.py
+++ b/urlgrabber/grabber.py
@@ -2291,6 +2291,8 @@ class _TH:
     def update(url, dl_size, dl_time, ug_err):
         _TH.load()
         host = urlparse.urlsplit(url).netloc
+        if not host: # file://
+            return
         speed, fail, ts = _TH.hosts.get(host) or (0, 0, 0)
         now = time.time()

But I think that file:// mirrors SHOULD be profiled, too, so this bug needs a more complex fix.  Also, urlspilt() does not strip USER:PASS@ prefix so this ends up in timedhosts (ouch), have to fix this, too.

It's not particular to me so.  Yippee, I'm not mad :)

I am seeing it too. That's why I added myself as a cc last night.

python-urlgrabber-3.9.1-13.fc18 works for me.

with
python-urlgrabber-3.9.1-13.fc18.noarch
yum-3.4.3-26.fc18.noarch

Works only "once", on second call 

Traceback (most recent call last):
  File "/usr/bin/yum", line 29, in <module>
    yummain.user_main(sys.argv[1:], exit_code=True)
  File "/usr/share/yum-cli/yummain.py", line 321, in user_main
    errcode = main(args)
  File "/usr/share/yum-cli/yummain.py", line 146, in main
    result, resultmsgs = base.doCommands()
  File "/usr/share/yum-cli/cli.py", line 485, in doCommands
    return self.yum_cli_commands[self.basecmd].doCommand(self, self.basecmd, self.extcmds)
  File "/usr/share/yum-cli/yumcommands.py", line 405, in doCommand
    return base.updatePkgs(extcmds, update_to=(basecmd == 'update-to'))
  File "/usr/share/yum-cli/cli.py", line 890, in updatePkgs
    self.update()
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 4363, in update
    updates = self.up.getUpdatesTuples()
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 1031, in <lambda>
    up = property(fget=lambda self: self._getUpdates(),
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 836, in _getUpdates
    self._up = rpmUtils.updates.Updates(self.rpmdb.simplePkgList(), self.pkgSack.simplePkgList())
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 1012, in <lambda>
    pkgSack = property(fget=lambda self: self._getSacks(),
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 776, in _getSacks
    self.repos.populateSack(which=repos)
  File "/usr/lib/python2.7/site-packages/yum/repos.py", line 299, in populateSack
    self.doSetup()
  File "/usr/lib/python2.7/site-packages/yum/repos.py", line 125, in doSetup
    self.retrieveAllMD()
  File "/usr/lib/python2.7/site-packages/yum/repos.py", line 94, in retrieveAllMD
    urlgrabber.grabber.parallel_wait()
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 2198, in parallel_wait
    perform()
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 2145, in perform
    for opts, size, ug_err in dl.perform():
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 2093, in perform
    done = self.running[fd].perform()
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 2063, in perform
    _TH.update(opts.url, int(line[2]), float(line[3]), ug_err, opts.async[0])
  File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 2308, in update
    speed = (k1 * speed + k2 * dl_size / dl_time) / (k1 + k2)
ZeroDivisionError: float division by zero

in timedhosts
  file:/home/rpmbuild/site/rpms/fedora/17/remi/i386/ 438764923 0 1337357074
  ftp.free.fr 52873 0 1337357084
  ftp.proxad.net 5146 0 1337357084

I'm seeing this as well.

> file:/home/rpmbuild/site/rpms/fedora/17/remi/i386/

I believe that this is an invalid URI. It should be file:///home/...

Same error with file:///home uri.

Adding the trivial test, is a workaround.
    if (dl_time > 0) and ((k1+k2) > 0):
        speed = (k1 * speed + k2 * dl_size / dl_time) / (k1 + k2)

> Works only "once", on second call

Apparently, local "file://" mirrors are infinitely fast once the files got buffered :)  Added a sanity check and changed the speed averaging in python-urlgrabber-3.9.1-14.fc18

python-urlgrabber-3.9.1-14.fc18 seems ok (cannot reproduce the error)
Thanks for the fix.

This bug appears to have been reported against 'rawhide' during the Fedora 19 development cycle.
Changing version to '19'.

(As we did not run this process for some time, it could affect also pre-Fedora 19 development
cycle bugs. We are very sorry. It will help us with cleanup during Fedora 19 End Of Life. Thank you.)

More information and reason for this action is here:
https://fedoraproject.org/wiki/BugZappers/HouseKeeping/Fedora19

This should probably be closed as FIXED. I haven't seen this bug in ages (Rawhide, 19 (though no file:// repos there), and 18).