Bug 915330
| Summary: | Repository creation degrades greatly compared to v1 | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Product: | [Retired] Pulp | Reporter: | Justin Sherrill <jsherril> | ||||||||
| Component: | rpm-support | Assignee: | Barnaby Court <bcourt> | ||||||||
| Status: | CLOSED CURRENTRELEASE | QA Contact: | Preethi Thomas <pthomas> | ||||||||
| Severity: | unspecified | Docs Contact: | |||||||||
| Priority: | unspecified | ||||||||||
| Version: | 2.0.6 | CC: | bcourt, jason.dobies, skarmark | ||||||||
| Target Milestone: | --- | Keywords: | Triaged | ||||||||
| Target Release: | 2.3.0 | ||||||||||
| Hardware: | Unspecified | ||||||||||
| OS: | Unspecified | ||||||||||
| Whiteboard: | |||||||||||
| Fixed In Version: | Doc Type: | Bug Fix | |||||||||
| Doc Text: | Story Points: | --- | |||||||||
| Clone Of: | Environment: | ||||||||||
| Last Closed: | 2013-12-09 14:31:13 UTC | Type: | Bug | ||||||||
| Regression: | --- | Mount Type: | --- | ||||||||
| Documentation: | --- | CRM: | |||||||||
| Verified Versions: | Category: | --- | |||||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||||
| Embargoed: | |||||||||||
| Bug Depends On: | |||||||||||
| Bug Blocks: | 854726 | ||||||||||
| Attachments: |
|
||||||||||
|
Description
Justin Sherrill
2013-02-25 14:29:24 UTC
Created attachment 702366 [details]
script used to generate 1600 repos and record timings
Created attachment 702367 [details]
resultts showing slowing of creation
Does the performance get back to normal afterwords? My gut reaction is that it's the tasking subsystem having more and more data to resolve against. What I want to see is if the tasks clear themselves out once they've completed and things go back to normal. Nope, creating repos 1601-1605 still took around 6 seconds a piece, after waiting ~8 hours after the first 1600 were created. Ok cool, thanks for checking. Also to note, I re-ran the tests on a clean pulp server without the feed certs and the problem still occurred, although it was slightly better. After making 1600 repos, i waited ~90 minutes and created 5 more, each one took around 5.5 seconds. We've done some investigation into this. The creation and updating of repos gets slower and slower the more repos that exist because they invoke configuration validation, which inspects the configuration of every other repo of the same type (i.e. same importer) for conflicts. In the reported use case, this is every repo, on every create and every update. Pull requests have been submitted: https://github.com/pulp/pulp_rpm/pull/319 https://github.com/pulp/pulp_puppet/pull/66 https://github.com/pulp/pulp/pull/588 build: 2.3.0-0.10.alpha Created attachment 808927 [details]
Repo create result after the fix
verified [root@hp-dl360g7-01 ~]# rpm -qa pulp-server pulp-server-2.3.0-0.17.beta.el6.noarch [root@hp-dl360g7-01 ~]# Pulp 2.3 released. |