Bug 2065832

Summary: oc mirror hangs when processing the Red Hat 4.10 catalog
Product: OpenShift Container Platform Reporter: Jennifer Power <jpower>
Component: ocAssignee: Jennifer Power <jpower>
oc sub component: oc-mirror QA Contact: zhou ying <yinzhou>
Status: CLOSED ERRATA Docs Contact:
Severity: urgent    
Priority: unspecified CC: aflom, anbhatta, aos-bugs, jpower, knarra, vdinh
Version: 4.10   
Target Milestone: ---   
Target Release: 4.10.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 2069307 (view as bug list) Environment:
Last Closed: 2022-04-21 13:16:01 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 2069307    
Bug Blocks:    

Description Jennifer Power 2022-03-18 20:13:02 UTC
Description of problem:

When running opm alpha diff with this Red Hat 4.10 catalog it hangs

opm alpha diff registry.redhat.io/redhat/redhat-operator-index:v4.10
...
WARN[0034] DEPRECATION NOTICE:
Sqlite-based catalogs and their related subcommands are deprecated. Support for
them will be removed in a future release. Please migrate your catalog workflows
to the new file-based catalog format. 
...

This does not occur with other catalogs (certified catalog) or with an include.yaml.


Version-Release number of selected component (if applicable):

Version: version.Version{OpmVersion:"v1.21.0", GitCommit:"9999f796", BuildDate:"2022-03-03T21:23:12Z", GoOs:"linux", GoArch:"amd64"}


How reproducible:
100%


Steps to Reproduce:
1.opm alpha diff registry.redhat.io/redhat/redhat-operator-index:v4.10


Actual results:

The application hangs with no output


Expected results:

The application to render a catalog successfully


Additional info:

GitHub issue https://github.com/operator-framework/operator-registry/issues/936

Comment 2 Anik 2022-03-24 16:10:33 UTC
Moving this over to oc since oc-mirror (which uses the `operator-registry/declcfg` package that has the opm alpha diff implementation) is what we're interested in fixing/testing.

Comment 3 Alex 2022-03-28 17:14:12 UTC
this BZ needs to target 4.10, but I am unable to set the target release.

Comment 4 zhou ying 2022-04-02 03:30:47 UTC
Use the same imageset:
cat imageset.yaml 
apiVersion: mirror.openshift.io/v1alpha1
kind: ImageSetConfiguration
mirror:
  operators:
    - catalog: registry.redhat.io/redhat/redhat-operator-index:v4.10
Checked with older version without the pr, could reproduced:

./oc-mirror version 
Client Version: version.Info{Major:"0", Minor:"1", GitVersion:"v0.1.0", GitCommit:"63d070c19e8f5b6c84b0b3339102c307ad1cac05", GitTreeState:"clean", BuildDate:"2022-03-31T17:05:48Z", GoVersion:"go1.17.5", Compiler:"gc", Platform:"linux/amd64"}
[root@localhost ocmirrortest]# ./oc-mirror --config imageset.yaml file://
INFO Creating directory: oc-mirror-workspace/src/publish 
INFO Creating directory: oc-mirror-workspace/src/v2 
INFO Creating directory: oc-mirror-workspace/src/charts 
WARN[0055] DEPRECATION NOTICE:
Sqlite-based catalogs and their related subcommands are deprecated. Support for
them will be removed in a future release. Please migrate your catalog workflows
to the new file-based catalog format. 



./oc-mirror version 
Client Version: version.Info{Major:"0", Minor:"1", GitVersion:"v0.1.0", GitCommit:"28092a8985a00a31e910ee8076ee847f611df4f1", GitTreeState:"clean", BuildDate:"2022-04-02T02:35:17Z", GoVersion:"go1.17.8", Compiler:"gc", Platform:"linux/amd64"}
 ./oc-mirror --config imageset.yaml file://
....
    manifests:
      sha256:209c8f43ffb954e7a500e58823992ecd631c8f9c4c83ece10eaaed20f024139b
      sha256:8b606d5c487f4e016cfbf2160c6bee2276243e97da0cd16792458be656cc8835
      sha256:209c8f43ffb954e7a500e58823992ecd631c8f9c4c83ece10eaaed20f024139b -> 33b50287
  stats: shared=307 unique=3481 size=117.1GiB ratio=0.92

error: unable to retrieve source image registry.redhat.io/container-native-virtualization/kubevirt-velero-plugin-rhel8 manifest sha256:0c5c9c6a12f906a092d105842158a1eda8c21b9681b0bbd6f51a829d927bde60: unknown: Not Found
error: unable to retrieve source image registry.redhat.io/openshift4/ose-cloud-event-proxy manifest sha256:1ea23957c50885f5c26dce74ea6c88bb579dc684cbb29043ece6aece33073504: error parsing HTTP 404 response body: invalid character 'N' looking for beginning of value: "Not found\n"
error: unable to retrieve source image registry.access.redhat.com/ubi8/openjdk-11 manifest sha256:03ba993c5d7459eb2d92b4c88ac3561633d05716760e62e5da5f04292ae287b8: error parsing HTTP 404 response body: invalid character 'N' looking for beginning of value: "Not found\n"
error: unable to retrieve source image registry.redhat.io/rhpam-7/rhpam-kogito-rhel8-operator manifest sha256:7aa5491e5d26b29cd0e271d24996e587a65b50f5a8d871bd004b53da65ee0038: error parsing HTTP 404 response body: invalid character 'N' looking for beginning of value: "Not found\n"
error mirroring image: an error occurred during planning
error: image "registry.redhat.io/3scale-amp2/3scale-rhel7-operator-metadata@sha256:bd95d5f4346063b9fb729da0efd4f6b223f4b9453bb8c2ee4d179ce8b7851f3e" mapping "3scale-amp2/3scale-rhel7-operator-metadata": stat oc-mirror-workspace/src/v2/3scale-amp2/3scale-rhel7-operator-metadata: no such file or directory

Comment 6 RamaKasturi 2022-04-05 17:12:10 UTC
I see that bug has been already verified via pre-merge method, so moving it to verified state.

Comment 7 RamaKasturi 2022-04-05 17:23:13 UTC
(In reply to RamaKasturi from comment #6)
> I see that bug has been already verified via pre-merge method, so moving it
> to verified state.

Moving it back to ON_QA state, will let yinzhou move it to verified state.

Comment 13 errata-xmlrpc 2022-04-21 13:16:01 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.10.10 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:1356