Bug 2102766

Summary:	OCP 4.12 Using RHCOS 411.84
Product:	OpenShift Container Platform	Reporter:	Forrest Babcock <fbabcock>
Component:	RHCOS	Assignee:	Michael Nguyen <mnguyen>
Status:	CLOSED ERRATA	QA Contact:	HuijingHei <hhei>
Severity:	urgent	Docs Contact:
Priority:	unspecified
Version:	4.12	CC:	dornelas, fbabcock, jligon, mrussell, nstielau, qzhang, sdodson, smilner, stbenjam, wking
Target Milestone:	---
Target Release:	4.12.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2023-01-17 19:51:09 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Forrest Babcock 2022-06-30 15:06:44 UTC

We are seeing a high rate of failures in OCP 4.12 presubmit jobs and see that 4.12 is using an older RHCOS version than 4.11.  This is blocking jobs for OCP 4.12.


https://amd64.ocp.releases.ci.openshift.org/releasestream/4.12.0-0.ci/release/4.12.0-0.ci-2022-06-30-101928
Red Hat Enterprise Linux CoreOS 411.84.202202222101-0


https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/origin-ci-test/pr-logs/pull/27251/pull-ci-openshift-origin-master-e2e-aws-fips/1542441144380559360/artifacts/e2e-aws-fips/gather-aws-console/artifacts/i-0077a46bc803ee135

Welcome to [0;31mRed Hat Enterprise Linux CoreOS 411.84.202202222101-0 (Ootpa)[0m!



We understand there is work being done by RHCOS team to support 4.12 but we need to get 4.12 updated to the same version of RHCOS as 4.11.

https://amd64.ocp.releases.ci.openshift.org/releasestream/4.11.0-0.ci/release/4.11.0-0.ci-2022-06-29-214222:
Red Hat Enterprise Linux CoreOS upgraded from 411.86.202206172255-0 to 411.86.202206291708-0

Comment 1 W. Trevor King 2022-06-30 17:09:54 UTC

This is expected to be the reason for bug 2102369, resulting in large failure rates for test-cases like:

  Probing container should *not* be restarted with a non-local redirect http liveness probe

I'm raising to 'urgent' until we have some way to get 4.12 presubmits flowing again.

Comment 2 Steve Milner 2022-06-30 17:43:19 UTC

It looks like the prow job is disabled for 4.12. This is most likely fallout from reverting 8.6 content during development and debugging in 4.11 but somehow was copied into 4.12. Mike is going to follow up with the ART team to get that job re-enabled.

Comment 4 Michael Nguyen 2022-07-01 00:32:25 UTC

https://amd64.ocp.releases.ci.openshift.org/releasestream/4.12.0-0.ci/release/4.12.0-0.ci-2022-06-30-233303 is showing the following RHCOS now

Components

    Kubernetes 1.24.0
    Red Hat Enterprise Linux CoreOS upgraded from 411.84.202202222101-0 to 412.86.202206301758-0 (diff)

Comment 5 HuijingHei 2022-07-01 03:02:39 UTC

Check the latest https://amd64.ocp.releases.ci.openshift.org/releasestream/4.12.0-0.ci/release/4.12.0-0.ci-2022-07-01-025204 is using `Red Hat Enterprise Linux CoreOS 412.86.202206301758-0` now

Comment 8 errata-xmlrpc 2023-01-17 19:51:09 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.12.0 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:7399