2068170 – openstack tripleo container image list returns nothing with 2 level of namespaces

Bug 2068170 - openstack tripleo container image list returns nothing with 2 level of namespaces

Summary: openstack tripleo container image list returns nothing with 2 level of namesp...

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openstack-tripleo-common
Sub Component:
Version:	16.1 (Train)
Hardware:	Unspecified
OS:	Unspecified
Priority:	medium
Severity:	medium
Target Milestone:	z9
Target Release:	16.1 (Train on RHEL 8.2)
Assignee:	Cédric Jeanneret
QA Contact:	David Rosenfeld
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2022-03-24 14:56 UTC by dvd
Modified:	2022-12-07 20:26 UTC (History)
CC List:	8 users (show)
Fixed In Version:	openstack-tripleo-common-11.4.1-1.20220803063749.75bd92a.el8ost
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2022-12-07 20:26:20 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Links
System	ID	Priority	Status	Summary	Last Updated
Launchpad	1966222	None	None	None	2022-03-24 14:56:13 UTC
OpenStack gerrit	835084	None	NEW	build_catalog should loop deeper than one level	2022-03-24 14:56:13 UTC
Red Hat Issue Tracker	OSP-14243	None	None	None	2022-03-24 15:03:47 UTC
Red Hat Product Errata	RHBA-2022:8795	None	None	None	2022-12-07 20:26:38 UTC

Description dvd 2022-03-24 14:56:13 UTC

This issue happens on both osp16.1 and osp16.2.

As you can see in containers-prepare-parameter.yaml [1] and podman images [2], we have a two-levels namespace "nfvi/bmaas_mk1" in this case.

This causes our catalog to look like this:
~~~
[root@undercloud ~]# cat /var/lib/image-serve/v2/_catalog
{"repositories": ["nfvi/bmaas_mk1"]}
~~~

As opposed to the default deployment where the catalog looks like this:
~~~
(undercloud) [stack@undercloud ~]$ cat /var/lib/image-serve/v2/_catalog
{"repositories": ["rhosp-rhel8/openstack-mistral-event-engine", "rhosp-rhel8/openstack-haproxy", ...
~~~

We can also see in the image_serve_access.log that tripleoclient is trying to fetch the tags of nfvi/bmaas_mk1, assuming it's an image but in fact, the images are one level deeper [3]
~~~
192.168.4.132 - - [24/Mar/2022:07:22:07 -0600] "GET /v2/ HTTP/1.1" 200 2 "-" "python-requests/2.20.0"
192.168.4.132 - - [24/Mar/2022:07:22:12 -0600] "GET /v2/_catalog HTTP/1.1" 200 36 "-" "python-requests/2.20.0"
192.168.4.132 - - [24/Mar/2022:07:22:12 -0600] "GET /v2/nfvi/bmaas_mk1/tags/list HTTP/1.1" 404 225 "-" "python-requests/2.20.0"
~~~

This is presumably because the build_catalog method isn't doing recursive listing [a]

[a] https://opendev.org/openstack/tripleo-common/src/branch/master/tripleo_common/image/image_export.py#L382-L391

[1]
~~~
parameter_defaults:
  ContainerImagePrepare:
  - push_destination: true
    excludes:
      - ceph
    set:
      name_prefix: openstack-
      name_suffix: ''
      namespace: registry.domain.net/nfvi/bmaas_mk1
      neutron_driver: openvswitch
      rhel_containers: false
      tag: '16.1'
    tag_from_label: '{version}-{release}'
~~~
[2]
~~~
(undercloud) [root@undercloud ~]# podman images
REPOSITORY TAG IMAGE ID CREATED SIZE
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-neutron-server 16.1 99cd047ab2b3 13 months ago 1.05 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-mistral-api 16.1 068190231471 13 months ago 1.1 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-neutron-l3-agent 16.1 716782d5eae9 13 months ago 1.06 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-nova-api 16.1 d9ee75bf0cca 13 months ago 1.13 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-swift-object 16.1 2f28fb71e0e0 13 months ago 694 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-zaqar-wsgi 16.1 564b79fb8447 13 months ago 686 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-ironic-conductor 16.1 865713766c1c 13 months ago 902 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-neutron-openvswitch-agent 16.1 bcde8e1a9b5d 13 months ago 917 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-nova-scheduler 16.1 51a5e3381cb0 13 months ago 1.26 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-keystone 16.1 063131fab0da 13 months ago 736 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-swift-proxy-server 16.1 f902045b6d16 13 months ago 740 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-neutron-dhcp-agent 16.1 b7e5a8137013 13 months ago 1.06 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-glance-api 16.1 63f41253e683 13 months ago 972 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-mistral-engine 16.1 a4f0724c1e19 13 months ago 1.08 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-heat-engine 16.1 94562653f4c9 13 months ago 893 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-swift-account 16.1 855b061c37cc 13 months ago 694 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-mistral-executor 16.1 8aeb4f967b71 13 months ago 1.5 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-ironic-pxe 16.1 9d7d231e0bed 13 months ago 763 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-swift-container 16.1 6f44548bc095 13 months ago 694 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-heat-api 16.1 3ecaf5c624f9 13 months ago 893 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-ironic-api 16.1 e25262748773 13 months ago 758 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-ironic-neutron-agent 16.1 195a6c84906c 13 months ago 917 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-nova-compute-ironic 16.1 ab5d2316ffdd 13 months ago 1.9 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-nova-conductor 16.1 c285a191a250 13 months ago 1.04 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-mistral-event-engine 16.1 340433e292af 13 months ago 1.08 GB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-ironic-inspector 16.1 e06e5517e6b4 13 months ago 660 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-placement-api 16.1 8799f05b38f7 13 months ago 696 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-tempest 16.1 2e9b78ffb878 13 months ago 939 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-rabbitmq 16.1 c40415f57b96 13 months ago 567 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-keepalived 16.1 b3a0a7ae8bab 13 months ago 403 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-haproxy 16.1 b9563306a0a0 13 months ago 523 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-cron 16.1 afcd28aa8e73 13 months ago 390 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-memcached 16.1 a19992aed6b4 13 months ago 411 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-mariadb 16.1 a2c393f117fa 13 months ago 718 MB
undercloud.domain.com:8787/nfvi/bmaas_mk1/openstack-iscsid 16.1 5db0e2f9bc81 13 months ago 395 MB
~~~

[3]
~~~
# find /var/lib/image-serve/v2/nfvi -type f -name list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-keystone/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-rsyslog/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ironic-conductor/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-neutron-l3-agent/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-neutron-dhcp-agent/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-cron/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-heat-api/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-swift-container/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-swift-object/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-qdrouterd/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-keepalived/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ironic-neutron-agent/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-mistral-event-engine/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-swift-account/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-placement-api/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-tempest/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-glance-api/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-mistral-api/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ironic-inspector/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-neutron-server/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-iscsid/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-mistral-executor/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-nova-compute-ironic/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-zaqar-wsgi/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-mistral-engine/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-haproxy/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-mariadb/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-nova-api/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ironic-pxe/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-heat-engine/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-memcached/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-nova-scheduler/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ironic-api/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-neutron-openvswitch-agent/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-rabbitmq/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-nova-conductor/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-swift-proxy-server/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ovn-controller/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ovn-northd/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ovn-nb-db-server/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-horizon/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-neutron-server-ovn/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-nova-novncproxy/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-heat-api-cfn/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-ovn-sb-db-server/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-redis/tags/list
/var/lib/image-serve/v2/nfvi/bmaas_mk1/openstack-neutron-metadata-agent/tags/list
~~~

Comment 3 Rabi Mishra 2022-04-07 11:05:22 UTC

Sorry did not see the linked patch.

Comment 18 errata-xmlrpc 2022-12-07 20:26:20 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 16.1.9 bug fix and enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:8795

Note You need to log in before you can comment on or make changes to this bug.