Bug 2221407

Summary: Satellite Capsule clamps reply to a max of 100 tags when listing the tags (break RHOSP)
Product: Red Hat Satellite Reporter: Vincent S. Cojot <vcojot>
Component: Container Management - ContentAssignee: Ian Ballou <iballou>
Status: CLOSED ERRATA QA Contact: Vladimír Sedmík <vsedmik>
Severity: high Docs Contact:
Priority: urgent    
Version: 6.12.4CC: iballou, osousa, pdudley, rlavi, vsedmik
Target Milestone: 6.14.0Keywords: Triaged
Target Release: Unused   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: rubygem-smart_proxy_container_gateway-1.0.8-1 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 2227902 2231499 (view as bug list) Environment:
Last Closed: 2023-11-08 14:19:54 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Vincent S. Cojot 2023-07-08 19:17:07 UTC
Description of problem:

We're using Satellite 6.12.4.1 (Satellite + Capsule) to serve RHOSP content (rpms and containers).

I've noticed that the capsule -clamps- the list of tags to 100 and the sonsequence is that this breaks 'openstack undercloud install' and the automation around it.

Version-Release number of selected component (if applicable):
6.12.4.1 on RHEL8.8

How reproducible:
100%

Steps to Reproduce:
1. Add RHOSP16 container repos to a satellite CV, promote and sync to the capsule.
2. List the container tags from the Satellite + Capsule.
3. All of the replies from the capsule are clamped to '100'.

* Satellite:
# skopeo list-tags docker://w0617ialabrhsat01.iaas.tdlab.ca:443/test-openstack-test_osp16-nfvi-evo-osp16-nfvi-evo-osp16-openstack-nova-api|grep '16\.[0-9]'|wc -l
102
# skopeo list-tags docker://w0617ialabrhsat01.iaas.tdlab.ca:443/test-openstack-test_osp16-nfvi-evo-osp16-nfvi-evo-osp16-openstack-nova-compute-ironic|grep '16\.[0-9]'|wc -l
112


* Capsule:
# skopeo list-tags docker://satellite-capsule01.maas:443/test-openstack-test_osp16-nfvi-evo-osp16-nfvi-evo-osp16-openstack-nova-api|grep '16\.[0-9]'|wc -l
100
# skopeo list-tags docker://satellite-capsule01.maas:443/test-openstack-test_osp16-nfvi-evo-osp16-nfvi-evo-osp16-openstack-nova-compute-ironic|grep '16\.[0-9]'|wc -l
100

Comment 1 Paul Dudley 2023-07-08 23:01:59 UTC
The issue here is on Capsules only. On Satellite, the results seem to be retrieved by Foreman from it's own DB. On a Capsule that doesn't exist so foreman-proxy asks Pulp to return the list. Once there the request for tags/list defines this `pagination_class = ContainerTagListPagination`, which just loops back to `api_settings.PAGE_SIZE:`, and we can find this in;
~~~
[root@capsule1 ~]# grep PAGE_SIZE /usr/lib/python3.9/site-packages/pulpcore/app/settings.py
    "PAGE_SIZE": 100,
~~~

You can see there Pulp defaults to returning 100 lines per page, and we need to increase that to get beyond this problem, at least temporarily.

Comment 3 Ian Ballou 2023-07-26 21:42:51 UTC
Created redmine issue https://projects.theforeman.org/issues/36616 from this bug

Comment 4 Bryan Kearney 2023-07-27 00:03:15 UTC
Upstream bug assigned to iballou

Comment 5 Bryan Kearney 2023-07-27 00:03:17 UTC
Upstream bug assigned to iballou

Comment 6 Vladimír Sedmík 2023-08-11 08:56:27 UTC
Verified in 6.14.0 snap 11 (with rubygem-smart_proxy_container_gateway-1.0.8-1.el8sat.noarch)

Same steps like https://bugzilla.redhat.com/show_bug.cgi?id=2227902#c2, same result:

[user@localhost ~]$ skopeo list-tags --tls-verify=false --username=admin --password=heslo docker://sat.redhat.com/default_organization-jetstack-jetstack_cert-manager-controller | grep '"' | wc -l
823

[user@localhost ~]$ skopeo list-tags --tls-verify=false --username=admin --password=heslo docker://caps.redhat.com/default_organization-jetstack-jetstack_cert-manager-controller | grep '"' | wc -l
823

[user@localhost ~]$ diff <(skopeo list-tags --tls-verify=false --username=admin --password=heslo docker://sat.redhat.com/default_organization-jetstack-jetstack_cert-manager-controller | sort) <(skopeo list-tags --tls-verify=false --username=admin --password=heslo docker://caps.redhat.com/default_organization-jetstack-jetstack_cert-manager-controller | sort)
608c608
<     "Repository": "sat.redhat.com/default_organization-jetstack-jetstack_cert-manager-controller",
---
>     "Repository": "caps.redhat.com/default_organization-jetstack-jetstack_cert-manager-controller",

Comment 9 errata-xmlrpc 2023-11-08 14:19:54 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: Satellite 6.14 security and bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2023:6818