Bug 1234907

Summary: [perf] Slow dep solving with large set of packages
Product: [Fedora] Fedora Reporter: Zdenek Kabelac <zkabelac>
Component: dnfAssignee: Packaging Maintenance Team <packaging-team-maint>
Status: CLOSED DUPLICATE QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 23CC: jsilhan, mluscon, packaging-team-maint, pnemade, rholy, tim.lauridsen, vmukhame
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-07-29 11:37:58 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
My current list of rawhide rpm packages
none
timed dnf upgrade --assumeno
none
/var/log/hawkey.log none

Description Zdenek Kabelac 2015-06-23 13:23:48 UTC
Description of problem:

My today's rawhide upgrade seems to be very CPU intensive task for 'dnf'.
It spends nearly 1.5 minute before it starts to download package from the moment I confirm upgrade transaction.

I've even upgraded to very later libsolv library available at koji/updates.

Perf record seems to point to heavy usage of these functions:

    46.01%              dnf  libsolv.so.0                   [.] dataiterator_step                                                 
                        |
                        --- dataiterator_step

     8.53%              dnf  libc-2.21.90.so                [.] __GI___strcmp_ssse3                                               
                        |
                        --- __GI___strcmp_ssse3

     7.38%              dnf  libsolv.so.0                   [.] data_skip_key.isra.5                                              
                        |
                        --- data_skip_key.isra.5                         

     4.29%              dnf  libhawkey.so.2                 [.] 0x000000000000f425                                                
                        |          
                        |--34.48%-- 0x7fadf9b157d6
                        |          hy_query_run_set
                        |          0x55fc8051a108
                        |          
                        |--14.16%-- 0x7fadf9b15425
                        |          hy_query_run_set
                        |          0x55fc8051a108

     4.29%              dnf  libc-2.21.90.so                [.] strlen                                                            
                        |
                        --- strlen


Version-Release number of selected component (if applicable):
libsolv-0.6.11-1.fc23.x86_64

How reproducible:


Steps to Reproduce:
1.dnf upgrade
2.confirm 'y'
3.measure time before download really starts

Actual results:


Expected results:


Additional info:

Comment 1 Zdenek Kabelac 2015-06-23 13:25:21 UTC
Created attachment 1042319 [details]
My current list of rawhide rpm packages

Comment 2 Zdenek Kabelac 2015-06-23 13:26:54 UTC
Created attachment 1042331 [details]
timed  dnf upgrade --assumeno

Comment 3 Zdenek Kabelac 2015-06-23 13:36:55 UTC
Created attachment 1042337 [details]
/var/log/hawkey.log

Comment 4 Jan Kurik 2015-07-15 13:55:36 UTC
This bug appears to have been reported against 'rawhide' during the Fedora 23 development cycle.
Changing version to '23'.

(As we did not run this process for some time, it could affect also pre-Fedora 23 development
cycle bugs. We are very sorry. It will help us with cleanup during Fedora 23 End Of Life. Thank you.)

More information and reason for this action is here:
https://fedoraproject.org/wiki/BugZappers/HouseKeeping/Fedora23

Comment 5 Honza Silhan 2015-07-29 11:37:58 UTC

*** This bug has been marked as a duplicate of bug 1194222 ***

Comment 6 Honza Silhan 2015-07-29 11:39:02 UTC
I think the cause is the bad performance of queries. The depsolving is fast.