Bug 979042 - Slow download of packages
Summary: Slow download of packages
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: dnf
Version: rawhide
Hardware: Unspecified
OS: Unspecified
low
unspecified
Target Milestone: ---
Assignee: Ales Kozumplik
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2013-06-27 13:25 UTC by Zdenek Kabelac
Modified: 2014-09-30 23:41 UTC (History)
4 users (show)

Fixed In Version: dnf-0.3.11-1.git7d717c7.fc19
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2013-08-16 23:05:37 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)

Description Zdenek Kabelac 2013-06-27 13:25:06 UTC
Description of problem:

I've tested dnf on my Rawhide installation when 'yum upgrade --skip-broken' was unable to resolve dependencies and it has ignored many package from upgrade transaction (Bug863044).  While the transaction has been nicely resolved and 3/4 of package has been properly marked for upgrade, the download part it self has been pretty slow compared with 'yum' performance here.
My DSL provider has pretty decent connection speed and individual package download rate was above 1MB/s - however between the download of each package there was quite noticeable delay in range of 2-3 seconds (which sums up, when >100 packages is upgraded)


Version-Release number of selected component (if applicable):
dnf-0.3.8-2.git85524ae.fc20.noarch

How reproducible:


Steps to Reproduce:
1. dnf upgrade
2.
3.

Actual results:


Expected results:


Additional info:

Comment 1 Ales Kozumplik 2013-06-27 13:38:17 UTC
I saw this too, some digging needs to take place to decide whether this is a librepo issue or whether we do something strange ourselves.

Low prio at this point.

Comment 2 Ales Kozumplik 2013-06-27 14:11:17 UTC
The observed delay before download start is due to how the progress bar is implemented: it is waiting for librepo to tell us the total package size, which for some involved reasons can not do so right away, even though the download has already started. As zpavlas pointed out we should be able to deduce this information from the available metadata instead.

Assigning to zpavlas who already did patching in this area.

Notwithstanding the console output the total download time is probably going to be larger than in the current Yum versions due to the missing support of parallel package downloads (bug 909744).

Comment 3 Ales Kozumplik 2013-07-24 14:38:18 UTC
(In reply to Ales Kozumplik from comment #2)
> The observed delay before download start is due to how the progress bar is
> implemented: it is waiting for librepo to tell us the total package size,

Actually, this is only a part of the problem. As I found out today, most time is lost because DNF creates an extra librepo handle for each package download and these need to sync the mirrorlist first to know the real repo URL ("baseurl"). And that takes most of the extra time.

Comment 4 Ales Kozumplik 2013-07-25 12:51:30 UTC
Fixed the mirrorlist syncing (commit fecb703, will be in dnf-0.3.11), on a fast network this speeds up download of each package by approx. 1.5s. I consider this resolved then, and opened bug 988377 to deal with the progress bar dealy.

Comment 5 Fedora Update System 2013-08-13 10:47:16 UTC
dnf-0.3.11-1.git7d717c7.fc19 has been submitted as an update for Fedora 19.
https://admin.fedoraproject.org/updates/dnf-0.3.11-1.git7d717c7.fc19

Comment 6 Fedora Update System 2013-08-15 02:33:42 UTC
Package dnf-0.3.11-1.git7d717c7.fc19:
* should fix your issue,
* was pushed to the Fedora 19 testing repository,
* should be available at your local mirror within two days.
Update it with:
# su -c 'yum update --enablerepo=updates-testing dnf-0.3.11-1.git7d717c7.fc19'
as soon as you are able to.
Please go to the following url:
https://admin.fedoraproject.org/updates/FEDORA-2013-14693/dnf-0.3.11-1.git7d717c7.fc19
then log in and leave karma (feedback).

Comment 7 Fedora Update System 2013-08-16 23:05:37 UTC
dnf-0.3.11-1.git7d717c7.fc19 has been pushed to the Fedora 19 stable repository.  If problems still persist, please make note of it in this bug report.


Note You need to log in before you can comment on or make changes to this bug.