Bug 1234907 - [perf] Slow dep solving with large set of packages
Summary: [perf] Slow dep solving with large set of packages
Keywords:
Status: CLOSED DUPLICATE of bug 1194222
Alias: None
Product: Fedora
Classification: Fedora
Component: dnf
Version: 23
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Packaging Maintenance Team
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-06-23 13:23 UTC by Zdenek Kabelac
Modified: 2015-07-29 11:39 UTC (History)
7 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-07-29 11:37:58 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
My current list of rawhide rpm packages (128.38 KB, text/plain)
2015-06-23 13:25 UTC, Zdenek Kabelac
no flags Details
timed dnf upgrade --assumeno (204.81 KB, text/plain)
2015-06-23 13:26 UTC, Zdenek Kabelac
no flags Details
/var/log/hawkey.log (145.44 KB, text/plain)
2015-06-23 13:36 UTC, Zdenek Kabelac
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 1194222 0 low CLOSED [perf] dnf reinstall `rpm -qa` is slow 2021-02-22 00:41:40 UTC

Internal Links: 1194222

Description Zdenek Kabelac 2015-06-23 13:23:48 UTC
Description of problem:

My today's rawhide upgrade seems to be very CPU intensive task for 'dnf'.
It spends nearly 1.5 minute before it starts to download package from the moment I confirm upgrade transaction.

I've even upgraded to very later libsolv library available at koji/updates.

Perf record seems to point to heavy usage of these functions:

    46.01%              dnf  libsolv.so.0                   [.] dataiterator_step                                                 
                        |
                        --- dataiterator_step

     8.53%              dnf  libc-2.21.90.so                [.] __GI___strcmp_ssse3                                               
                        |
                        --- __GI___strcmp_ssse3

     7.38%              dnf  libsolv.so.0                   [.] data_skip_key.isra.5                                              
                        |
                        --- data_skip_key.isra.5                         

     4.29%              dnf  libhawkey.so.2                 [.] 0x000000000000f425                                                
                        |          
                        |--34.48%-- 0x7fadf9b157d6
                        |          hy_query_run_set
                        |          0x55fc8051a108
                        |          
                        |--14.16%-- 0x7fadf9b15425
                        |          hy_query_run_set
                        |          0x55fc8051a108

     4.29%              dnf  libc-2.21.90.so                [.] strlen                                                            
                        |
                        --- strlen


Version-Release number of selected component (if applicable):
libsolv-0.6.11-1.fc23.x86_64

How reproducible:


Steps to Reproduce:
1.dnf upgrade
2.confirm 'y'
3.measure time before download really starts

Actual results:


Expected results:


Additional info:

Comment 1 Zdenek Kabelac 2015-06-23 13:25:21 UTC
Created attachment 1042319 [details]
My current list of rawhide rpm packages

Comment 2 Zdenek Kabelac 2015-06-23 13:26:54 UTC
Created attachment 1042331 [details]
timed  dnf upgrade --assumeno

Comment 3 Zdenek Kabelac 2015-06-23 13:36:55 UTC
Created attachment 1042337 [details]
/var/log/hawkey.log

Comment 4 Jan Kurik 2015-07-15 13:55:36 UTC
This bug appears to have been reported against 'rawhide' during the Fedora 23 development cycle.
Changing version to '23'.

(As we did not run this process for some time, it could affect also pre-Fedora 23 development
cycle bugs. We are very sorry. It will help us with cleanup during Fedora 23 End Of Life. Thank you.)

More information and reason for this action is here:
https://fedoraproject.org/wiki/BugZappers/HouseKeeping/Fedora23

Comment 5 Honza Silhan 2015-07-29 11:37:58 UTC

*** This bug has been marked as a duplicate of bug 1194222 ***

Comment 6 Honza Silhan 2015-07-29 11:39:02 UTC
I think the cause is the bad performance of queries. The depsolving is fast.


Note You need to log in before you can comment on or make changes to this bug.