Bug 2011960

Summary:	[tracker] Storage operator is not available after reboot cluster instances
Product:	OpenShift Container Platform	Reporter:	Benjamin Gilbert <bgilbert>
Component:	RHCOS	Assignee:	Micah Abbott <miabbott>
Status:	CLOSED ERRATA	QA Contact:	Michael Nguyen <mnguyen>
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	4.9	CC:	aos-bugs, bgilbert, ccoleman, dhellmann, dornelas, ehashman, fbertina, jima, jligon, miabbott, mrussell, nstielau, pehunt, prkumar, rphillips, schoudha, smilner, tsze, wking, yunjiang
Target Milestone:	---
Target Release:	4.10.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	No Doc Update
Doc Text:		Story Points:	---
Clone Of:	1997478	Environment:
Last Closed:	2022-03-10 16:18:05 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1997478, 2004596
Bug Blocks:	2011961

Comment 1 Micah Abbott 2021-10-11 16:39:39 UTC

https://bugzilla.redhat.com/show_bug.cgi?id=1997478 links to https://github.com/openshift/kubernetes/pull/999 which was merged with commit `86b82e1`

https://github.com/openshift/kubernetes/commit/86b82e1b205d82ef931c28f11de09225f6715641

The latest RHCOS 4.10 build (410.84.202110081440-0) includes `openshift-hyperkube-4.10.0-202110080521.p0.git.9312243.assembly.stream.el8`

The NVR of that `openshift-hyperkube` build points to commit `9312243` which is newer than `86b82e1`

https://github.com/openshift/kubernetes/commit/931224322c58da67eb8b3e9d4d3ff0e7dbf81cf2


A quick test on a single RHCOS node shows that the `kubelet` is at the version as expected:

```
[core@cosa-devsh ~]$ rpm-ostree status
State: idle
Deployments:
* ostree://67be3786510771cc550aa4be162f2b45cb796e4340755d7a67fa4720aa10e9ba
                   Version: 410.84.202110081440-0 (2021-10-08T14:43:28Z)
[core@cosa-devsh ~]$ rpm -q openshift-hyperkube
openshift-hyperkube-4.10.0-202110080521.p0.git.9312243.assembly.stream.el8.x86_64
[core@cosa-devsh ~]$ kubelet --version 
Kubernetes v1.22.1+9312243
```

Marking this as `Verified: Tested` to indicate that the fixed version of the `kubelet` is present in the RHCOS build.

Comment 2 RHCOS Bug Bot 2021-10-11 16:44:24 UTC

This bug has been reported fixed in a new RHCOS build and is ready for QE verification.  To mark the bug verified, set the Verified field to Tested.  This bug will automatically move to MODIFIED once the fix has landed in a new bootimage.

Comment 3 RHCOS Bug Bot 2021-10-20 17:53:45 UTC

The fix for this bug has landed in a bootimage bump, as tracked in bug 2004596 (now in status MODIFIED).  Moving this bug to MODIFIED.

Comment 5 Michael Nguyen 2021-10-25 14:09:00 UTC

Moving to verified now the boot image bump has been verified at  https://bugzilla.redhat.com/show_bug.cgi?id=2004596


$ oc get clusterversion
NAME      VERSION                              AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.10.0-0.nightly-2021-10-25-062528   True        False         9m36s   Cluster version is 4.10.0-0.nightly-2021-10-25-062528

Comment 8 errata-xmlrpc 2022-03-10 16:18:05 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.10.3 security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:0056