Bug 1109554 - [perf] dnf significantly slower than yum when using 'exclude'
Summary: [perf] dnf significantly slower than yum when using 'exclude'
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: dnf
Version: 20
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Honza Silhan
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-06-15 10:12 UTC by Stanislav Graf
Modified: 2015-08-03 14:53 UTC (History)
9 users (show)

Fixed In Version: hawkey-0.5.1-1.fc21
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2014-09-23 04:23:48 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)

Description Stanislav Graf 2014-06-15 10:12:39 UTC
Description of problem:
$ grep exclude /etc/yum.conf
exclude = *.i?86
$ grep exclude /etc/dnf/dnf.conf 
exclude = *.i?86

time dnf list gstreamer*
real    5m43.861s
user    5m33.169s
sys     0m3.220s

time yum list gstreamer*
real    0m15.664s
user    0m0.839s
sys     0m0.614s


Version-Release number of selected component (if applicable):
dnf-0.5.2-1.fc20.noarch
yum-3.4.3-148.fc20.noarch
yum-langpacks-0.4.3-1.fc20.noarch
yum-metadata-parser-1.1.4-9.fc20.x86_64
yum-utils-1.1.31-23.fc20.noarch

How reproducible:
100%
always reproducible

Steps to Reproduce:
1. Try yum and dnf with the same 'exclude'

Actual results:
'exclude' works
dnf is significantly slower than yum
dnf eating 100% CPU whole time

Expected results:
'exclude' works
dnf and yum has comparable speed

Additional info:

Comment 1 Radek Holy 2014-06-16 07:37:33 UTC
Hello, thank you for the report. We'll take a look.

Comment 2 Stanislav Graf 2014-07-23 06:18:29 UTC
I can help you test or I can provide debug information if needed. Feel
free to ping me, email me or needinfo me in case I can be helpful in
fixing this issue.

Comment 3 Ales Kozumplik 2014-07-29 13:24:54 UTC
Jan this is the performance issue we talked about. Please try to see whether something can be done about it with the new approach.

Comment 4 Honza Silhan 2014-08-12 10:36:20 UTC
Hi Stanislav, some changes have been made for excludes in Hawkey. If you really wanna help, can you try hawkey-0.5.0 and tell the difference, please?

Comment 5 Stanislav Graf 2014-08-12 17:21:41 UTC
Still reproducible with latest:

$ grep exclude /etc/yum.conf
exclude = *.i?86
$ grep exclude /etc/dnf/dnf.conf
exclude = *.i?86
$ rpm -qa 'hawkey*' 'dnf*' 'yum*' | sort
dnf-0.5.5-1.fc21.noarch
hawkey-0.5.0-1.fc21.x86_64
yum-3.4.3-153.fc21.noarch
yum-langpacks-0.4.3-2.fc21.noarch
yum-metadata-parser-1.1.4-13.fc21.x86_64
yum-utils-1.1.31-24.fc21.noarch

$ time yum list 'gstreamer*'
[...]
real    0m5.518s
user    0m0.624s
sys     0m0.134s

$ time dnf list 'gstreamer*'
[...]
real    5m48.631s
user    5m16.906s
sys     0m0.532s

Comment 6 Honza Silhan 2014-08-13 14:00:22 UTC
Thanks for the feedback although you brough bad news.

I did more testing:
dnf list -> fine
dnf list -x *.i686 -> slow
dnf list -x *.786 -> fine :)
dnf list -x python* -> fine
dnf list -x p*.i?86 -> fine
hawkey.Query(sack).filter(arch__glob="i?86") -> fine

it's neithter libsolv issue, nor hawkey query issue. I need to do more profiling.

Comment 7 Honza Silhan 2014-08-25 09:22:33 UTC
Fixed in the upstream.

Comment 8 Fedora Update System 2014-09-18 08:44:46 UTC
hawkey-0.5.1-1.fc21 has been submitted as an update for Fedora 21.
https://admin.fedoraproject.org/updates/hawkey-0.5.1-1.fc21

Comment 9 Stanislav Graf 2014-09-18 09:30:38 UTC
Nice!!! Fixed the issue for me.

Comment 10 Fedora Update System 2014-09-19 17:44:26 UTC
Package hawkey-0.5.1-1.fc21:
* should fix your issue,
* was pushed to the Fedora 21 testing repository,
* should be available at your local mirror within two days.
Update it with:
# su -c 'yum update --enablerepo=updates-testing hawkey-0.5.1-1.fc21'
as soon as you are able to.
Please go to the following url:
https://admin.fedoraproject.org/updates/FEDORA-2014-11102/hawkey-0.5.1-1.fc21
then log in and leave karma (feedback).

Comment 11 Fedora Update System 2014-09-23 04:23:48 UTC
hawkey-0.5.1-1.fc21 has been pushed to the Fedora 21 stable repository.  If problems still persist, please make note of it in this bug report.


Note You need to log in before you can comment on or make changes to this bug.