Description of problem:
As part of content view publish/promote, we remove docker content from an docker existing docker repo in a lifecycle environment. For repos with large amounts of content, this can take a long time:
~300 docker manifests seems to take ~2 minutes
~2000 docker manifests seems to take ~30 minutes
Version-Release number of selected component (if applicable):
Steps to Reproduce:
1. Sync a docker repo: https://quay.io datawire/ambassador
2. Publish the docker repo in a CV
3. Re-publish the CV
Should be fast
It appears that removing the docker manifests units in pulp is the slow piece
The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.
The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.
I am proceeding with a fix that won't require change katello changes.
There was some discussion about a potential workaround (https://pulp.plan.io/issues/4549#note-12) but that will not be necessary.
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.
I have an open PR for this issue. 2 things need to be highlighted:
1. The patch (as a side effect) fixed a bug, so there will be a subtle behavior change. https://pulp.plan.io/issues/5181
2. The patch will increase memory usage for removal tasks. On the issue, I put up some numbers and recommend going forward with this patch: https://pulp.plan.io/issues/4549#note-17
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.
All upstream Pulp bugs are at MODIFIED+. Moving this bug to POST.
Functional tests have been written (not yet merged): https://github.com/PulpQE/Pulp-2-Tests/pull/213
Created attachment 1602240 [details]
*** Satellite 6.5.2 Hotfix Available ***
1) Download pulp-docker-plugins-3.2.2-2.HOTFIXRHBZ1690070.el7sat.noarch.rpm from this bugzilla to your Satellite
rpm -Uvh pulp-docker-plugins-3.2.2-2.HOTFIXRHBZ1690070.el7sat.noarch.rpm
foreman-maintain service restart
4) resume operations
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.
For information on the advisory, and where to find the updated
files, follow the link below.
If the solution does not work for you, open a new bug report.
*** Bug 1768226 has been marked as a duplicate of this bug. ***