Bug 1573892
| Summary: | regenerate applicability of a consumer takes many minutes | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Product: | Red Hat Satellite | Reporter: | Pavel Moravec <pmoravec> | ||||||
| Component: | Pulp | Assignee: | satellite6-bugs <satellite6-bugs> | ||||||
| Status: | CLOSED ERRATA | QA Contact: | jcallaha | ||||||
| Severity: | high | Docs Contact: | |||||||
| Priority: | high | ||||||||
| Version: | 6.3.1 | CC: | amasolov, andrew.schofield, bkearney, bmbouter, cduryee, cmarinea, daniele, daviddavis, dconsoli, dkliban, fgarciad, gapatil, ggainey, hyu, ipanova, jentrena, jsenkyri, jstrong, kabbott, katello-qa-list, ktordeur, mhrivnak, mjia, mkearey, mmccune, mruzicka, pcreech, pdwyer, pmoravec, rchan, rplevka, ttereshc, vijsingh | ||||||
| Target Milestone: | Unspecified | Keywords: | FieldEngineering, Performance, PrioBumpField, Triaged | ||||||
| Target Release: | Unused | ||||||||
| Hardware: | x86_64 | ||||||||
| OS: | Linux | ||||||||
| Whiteboard: | |||||||||
| Fixed In Version: | pulp-rpm-2.13.4.9-1,pulp-2.13.4.11-1 | Doc Type: | If docs needed, set a value | ||||||
| Doc Text: | Story Points: | --- | |||||||
| Clone Of: | |||||||||
| : | 1596341 1596360 (view as bug list) | Environment: | |||||||
| Last Closed: | 2018-08-22 20:07:08 UTC | Type: | Bug | ||||||
| Regression: | --- | Mount Type: | --- | ||||||
| Documentation: | --- | CRM: | |||||||
| Verified Versions: | Category: | --- | |||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||
| Embargoed: | |||||||||
| Attachments: |
|
||||||||
|
Description
Pavel Moravec
2018-05-02 13:03:40 UTC
Another observation from the same customer / user scenario: remove orphans takes >6 hours (and still running with 100%CPU on mongo). (In reply to Pavel Moravec from comment #3) > Another observation from the same customer / user scenario: remove orphans > takes >6 hours (and still running with 100%CPU on mongo). Remove orphans took over 2 days there :-S The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug. The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug. All upstream Pulp bugs are at MODIFIED+. Moving this bug to POST. There must be a bug in serializers part of the patch, as units search of a repo fails. Try searches like:
pulpAdminPassword=$(grep ^default_password /etc/pulp/server.conf | cut -d' ' -f2)
repo=whatever-Repository-you-have
curl -i -H "Content-Type: application/json" -X POST -d "{\"criteria\":{\"type_ids\":[\"erratum\"],\"fields\":{\"unit\":[],\"association\":[\"unit_id\"]}}}" -u admin:$pulpAdminPassword https://$(hostname -f)/pulp/api/v2/repositories/${repo}/search/units/
(this POST request is queried by katello when processing Katello::Api::Rhsm::CandlepinProxiesController#get requests)
Created attachment 1446278 [details] tested patch Tested the cumulative patch of pulp_rpm PRs 1107 (without unit tests) and 1111 - see attached, applied via: cd /usr/lib/python2.7/site-packages/pulp_rpm cat /root/bz1573892-improvement-and-serializers.patch | patch -p3 (the above can be shared as officially _untested_ patch; "yum reinstall pulp-rpm-plugins" is a rollback) My testing results are all green: (*) reg.app. on the "benchmarked" consumers was still similarly significantly faster (3-20 times, now) (*) reg.app. properly updates errata applicability (played with downloading&upgrading&removing a package) (*) errata search works fine: repo=someRepoName curl -H "Content-Type: application/json" -X POST -d "{\"criteria\":{\"type_ids\":[\"erratum\"]}}" -u admin:$pulpAdminPassword https://$(hostname -f)/pulp/api/v2/repositories/${repo}/search/units/ (*) recursive units association works fine (tested per #c28) (*) previously failing errata search per #c31 works fine (*) tried several CV actions, all work OK The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug. The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug. The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug. The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug. Requesting needsinfo from upstream developer ttereshc because the 'FailedQA' flag is set. Requesting needsinfo from upstream developer ttereshc because the 'FailedQA' flag is set. Requesting needsinfo from upstream developer ttereshc because the 'FailedQA' flag is set. Requesting needsinfo from upstream developer ttereshc because the 'FailedQA' flag is set. Requesting needsinfo from upstream developer ttereshc because the 'FailedQA' flag is set. Requesting needsinfo from upstream developer ttereshc because the 'FailedQA' flag is set. There was a missed CP as we didn't associate 3886 https://pulp.plan.io/issues/3886 to this bug, moving back to POST Ignore above comment, I was looking at the wrong RPM/repo The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug. The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug. Created attachment 1475668 [details]
verification screenshot
Verified in Satellite 6.3.3 Snap 2.
Regenerate Applicability now only takes me less than a minute for RHEL 6 and RHEL 7 systems.
RHEL 6 Systems had 135 applicable updates.
RHEL 7 Systems had 376 applicable updates.
See attached screenshot for task execution times.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2018:2550 The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug. |