Bug 2059761

Summary: 4.9.23-s390x-machine-os-content manifest invalid when mirroring content for disconnected install
Product: OpenShift Container Platform Reporter: Vikas Laad <vlaad>
Component: ReleaseAssignee: Luke Meyer <lmeyer>
Status: CLOSED ERRATA QA Contact: Jeremy Poulin <jpoulin>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 4.9CC: aos-bugs, calfonso, chanphil, christian.lapolt, danili, fleber, Holger.Wolf, jpoulin, krmoser, lmeyer, madeel, mifiedle, scuppett, vlaad, walters, wking, wsun
Target Milestone: ---Flags: vlaad: needinfo-
Target Release: 4.10.0   
Hardware: s390x   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 2058421
: 2059762 (view as bug list) Environment:
Last Closed: 2022-03-10 16:44:40 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 2058421, 2060067    
Bug Blocks: 2059762    

Comment 3 Mike Fiedler 2022-03-02 12:58:01 UTC
@jpoulin @chanphil.com Can you please help with verification?   This should be available now in rc7:

https://s390x.ocp.releases.ci.openshift.org/releasestream/4-stable-s390x/release/4.10.0-rc.7

Comment 4 krmoser 2022-03-02 13:31:13 UTC
Folks,

1. We tested with the OCP 4.10.0-rc.7 build and unfortunately we encounter the same manifest invalid issue with the disconnected install mirror registry:

sha256:2a1588ed0f99e238e284d4dff10f60d180c892941c8e4d95dce4684e8452ed43 bastion:5000/ocp4/openshift4:4.10.0-rc.7-s390x-vsphere-csi-driver-operator
sha256:2a1588ed0f99e238e284d4dff10f60d180c892941c8e4d95dce4684e8452ed43 bastion:5000/ocp4/openshift4:4.10.0-rc.7-s390x-vsphere-csi-driver-syncer
sha256:2a1588ed0f99e238e284d4dff10f60d180c892941c8e4d95dce4684e8452ed43 bastion:5000/ocp4/openshift4:4.10.0-rc.7-s390x-vsphere-problem-detector
error: unable to push manifest to bastion:5000/ocp4/openshift4:4.10.0-rc.7-s390x-machine-os-content: manifest invalid: manifest invalid
info: Mirroring completed in 1m26.84s (91.55MB/s)
error: one or more errors occurred while uploading images


2. FYI. The RHCOS build is the same for RC.6 and RC.7:410.84.202202251632-0

Thank you,
Kyle

Comment 5 Mike Fiedler 2022-03-02 14:43:48 UTC
Moving to ASSIGNED based on comment 4.   cc:  @vlaad @walters

Comment 6 Jeremy Poulin 2022-03-02 17:37:40 UTC
Moving to on QA awaiting validation for rc8

Comment 7 Philip Chan 2022-03-02 18:21:56 UTC
Thank you for the updates -

We have successfully mirrored the RC.8 images for disconnected installation to our local registries.  These are the images residing on the CI servers.  We no longer encounter the manifest invalid error.  We will continue running through our installation and upgrade tests using this build and will also verify 4.10.0-rc.8 when it becomes available on quay.io.

Thank you,
Phil

Comment 8 Philip Chan 2022-03-03 20:00:55 UTC
We have now successfully completed all our disconnected install and upgrade tests using OCP 4.10.0-rc.8 and RHCOS 410.84.202202251632-0.  We used RC.8 from both CI and quay.io.  This was covered on both KVM and zVM platforms.  Note that the tests for the disconnected upgrade from OCP 4.9, we used OCP 4.9.22 since the latest 4.9.23 currently has the manifest invalid issue.

Comment 10 errata-xmlrpc 2022-03-10 16:44:40 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.10.3 security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:0056

Comment 11 Red Hat Bugzilla 2023-09-15 01:22:29 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 500 days