Bug 2065832 - oc mirror hangs when processing the Red Hat 4.10 catalog
Summary: oc mirror hangs when processing the Red Hat 4.10 catalog
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: oc
Version: 4.10
Hardware: Unspecified
OS: Unspecified
unspecified
urgent
Target Milestone: ---
: 4.10.z
Assignee: Jennifer Power
QA Contact: zhou ying
URL:
Whiteboard:
Depends On: 2069307
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-03-18 20:13 UTC by Jennifer Power
Modified: 2022-04-21 13:16 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 2069307 (view as bug list)
Environment:
Last Closed: 2022-04-21 13:16:01 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift oc-mirror pull 390 0 None open [release-4.10] Bug 2065832: bump operator-registry dep v1.21.1 2022-04-01 21:01:51 UTC
Red Hat Product Errata RHSA-2022:1356 0 None None None 2022-04-21 13:16:19 UTC

Description Jennifer Power 2022-03-18 20:13:02 UTC
Description of problem:

When running opm alpha diff with this Red Hat 4.10 catalog it hangs

opm alpha diff registry.redhat.io/redhat/redhat-operator-index:v4.10
...
WARN[0034] DEPRECATION NOTICE:
Sqlite-based catalogs and their related subcommands are deprecated. Support for
them will be removed in a future release. Please migrate your catalog workflows
to the new file-based catalog format. 
...

This does not occur with other catalogs (certified catalog) or with an include.yaml.


Version-Release number of selected component (if applicable):

Version: version.Version{OpmVersion:"v1.21.0", GitCommit:"9999f796", BuildDate:"2022-03-03T21:23:12Z", GoOs:"linux", GoArch:"amd64"}


How reproducible:
100%


Steps to Reproduce:
1.opm alpha diff registry.redhat.io/redhat/redhat-operator-index:v4.10


Actual results:

The application hangs with no output


Expected results:

The application to render a catalog successfully


Additional info:

GitHub issue https://github.com/operator-framework/operator-registry/issues/936

Comment 2 Anik 2022-03-24 16:10:33 UTC
Moving this over to oc since oc-mirror (which uses the `operator-registry/declcfg` package that has the opm alpha diff implementation) is what we're interested in fixing/testing.

Comment 3 Alex 2022-03-28 17:14:12 UTC
this BZ needs to target 4.10, but I am unable to set the target release.

Comment 4 zhou ying 2022-04-02 03:30:47 UTC
Use the same imageset:
cat imageset.yaml 
apiVersion: mirror.openshift.io/v1alpha1
kind: ImageSetConfiguration
mirror:
  operators:
    - catalog: registry.redhat.io/redhat/redhat-operator-index:v4.10
Checked with older version without the pr, could reproduced:

./oc-mirror version 
Client Version: version.Info{Major:"0", Minor:"1", GitVersion:"v0.1.0", GitCommit:"63d070c19e8f5b6c84b0b3339102c307ad1cac05", GitTreeState:"clean", BuildDate:"2022-03-31T17:05:48Z", GoVersion:"go1.17.5", Compiler:"gc", Platform:"linux/amd64"}
[root@localhost ocmirrortest]# ./oc-mirror --config imageset.yaml file://
INFO Creating directory: oc-mirror-workspace/src/publish 
INFO Creating directory: oc-mirror-workspace/src/v2 
INFO Creating directory: oc-mirror-workspace/src/charts 
WARN[0055] DEPRECATION NOTICE:
Sqlite-based catalogs and their related subcommands are deprecated. Support for
them will be removed in a future release. Please migrate your catalog workflows
to the new file-based catalog format. 



./oc-mirror version 
Client Version: version.Info{Major:"0", Minor:"1", GitVersion:"v0.1.0", GitCommit:"28092a8985a00a31e910ee8076ee847f611df4f1", GitTreeState:"clean", BuildDate:"2022-04-02T02:35:17Z", GoVersion:"go1.17.8", Compiler:"gc", Platform:"linux/amd64"}
 ./oc-mirror --config imageset.yaml file://
....
    manifests:
      sha256:209c8f43ffb954e7a500e58823992ecd631c8f9c4c83ece10eaaed20f024139b
      sha256:8b606d5c487f4e016cfbf2160c6bee2276243e97da0cd16792458be656cc8835
      sha256:209c8f43ffb954e7a500e58823992ecd631c8f9c4c83ece10eaaed20f024139b -> 33b50287
  stats: shared=307 unique=3481 size=117.1GiB ratio=0.92

error: unable to retrieve source image registry.redhat.io/container-native-virtualization/kubevirt-velero-plugin-rhel8 manifest sha256:0c5c9c6a12f906a092d105842158a1eda8c21b9681b0bbd6f51a829d927bde60: unknown: Not Found
error: unable to retrieve source image registry.redhat.io/openshift4/ose-cloud-event-proxy manifest sha256:1ea23957c50885f5c26dce74ea6c88bb579dc684cbb29043ece6aece33073504: error parsing HTTP 404 response body: invalid character 'N' looking for beginning of value: "Not found\n"
error: unable to retrieve source image registry.access.redhat.com/ubi8/openjdk-11 manifest sha256:03ba993c5d7459eb2d92b4c88ac3561633d05716760e62e5da5f04292ae287b8: error parsing HTTP 404 response body: invalid character 'N' looking for beginning of value: "Not found\n"
error: unable to retrieve source image registry.redhat.io/rhpam-7/rhpam-kogito-rhel8-operator manifest sha256:7aa5491e5d26b29cd0e271d24996e587a65b50f5a8d871bd004b53da65ee0038: error parsing HTTP 404 response body: invalid character 'N' looking for beginning of value: "Not found\n"
error mirroring image: an error occurred during planning
error: image "registry.redhat.io/3scale-amp2/3scale-rhel7-operator-metadata@sha256:bd95d5f4346063b9fb729da0efd4f6b223f4b9453bb8c2ee4d179ce8b7851f3e" mapping "3scale-amp2/3scale-rhel7-operator-metadata": stat oc-mirror-workspace/src/v2/3scale-amp2/3scale-rhel7-operator-metadata: no such file or directory

Comment 6 RamaKasturi 2022-04-05 17:12:10 UTC
I see that bug has been already verified via pre-merge method, so moving it to verified state.

Comment 7 RamaKasturi 2022-04-05 17:23:13 UTC
(In reply to RamaKasturi from comment #6)
> I see that bug has been already verified via pre-merge method, so moving it
> to verified state.

Moving it back to ON_QA state, will let yinzhou move it to verified state.

Comment 13 errata-xmlrpc 2022-04-21 13:16:01 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.10.10 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:1356


Note You need to log in before you can comment on or make changes to this bug.