Bug 1821997 - cri-o version in RHCOS is older than that in RHEL
Summary: cri-o version in RHCOS is older than that in RHEL
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: RHCOS
Version: 4.5
Hardware: Unspecified
OS: Unspecified
low
low
Target Milestone: ---
: 4.5.0
Assignee: Micah Abbott
QA Contact: Yang Yang
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-04-08 03:20 UTC by Yang Yang
Modified: 2020-07-13 17:26 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Cause: Incorrect version of cri-o included as part of RHCOS 4.5 Consequence: RHCOS nodes using wrong version of cri-o when compared to RHEL nodes Fix: Include cri-o 1.18 as part of RHCOS 4.5 Result: All nodes using correct version of cri-o
Clone Of:
Environment:
Last Closed: 2020-07-13 17:26:08 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2020:2409 0 None None None 2020-07-13 17:26:21 UTC

Description Yang Yang 2020-04-08 03:20:16 UTC
Description of problem:
cri-o version in RHCOS is older than that in RHEL

Version-Release number of selected component (if applicable):
# oc version
Client Version: 4.5.0-0.nightly-2020-04-07-093009
Server Version: 4.5.0-0.nightly-2020-04-07-093009
Kubernetes Version: v1.18.0-rc.1

How reproducible:
Always

Steps to Reproduce:
1. Set up a cluster
2. Check cri-o version via `oc get node -o wide` command, it is `v1.17.1`

# oc get node -o wide
NAME                                             STATUS   ROLES    AGE   VERSION   INTERNAL-IP   EXTERNAL-IP   OS-IMAGE                                                       KERNEL-VERSION                CONTAINER-RUNTIME
yy3878-xhgz5-m-0.c.openshift-qe.internal         Ready    master   93m   v1.17.1   10.0.0.3                    Red Hat Enterprise Linux CoreOS 45.81.202004070601-0 (Ootpa)   4.18.0-147.5.1.el8_1.x86_64   cri-o://1.17.0-9.dev.rhaos4.4.gitdfc8414.el8

3. Scale up some rhel worker, the scaled rhel worker is using `
v1.18.0-rc.1` cri-o

Actual results:
The cri-o version is out-of-date, even older than the one in rhel worker.

Expected results:
cri-o keep up-to-date, keep consistent with rhel worker.

Additional info:

Comment 1 Johnny Liu 2020-04-08 10:12:45 UTC
In mix rhcos and rhel worker cluster testing, keep consistent cri-o verison is an important test point in QE's testing, this is blocking QE's testing. I am not sure we should use lower version of cri-o in RHEL worker, or bump up version of cri-o in rhcos? Adding "testblocker" keyword.

Comment 2 Micah Abbott 2020-04-08 14:01:16 UTC
I'm not sure how RHEL worker nodes are getting `cri-o` 1.18...there is no 1.18 build available in Brew yet.  That version string being reported looks like the version of kubernetes.

Please check the output of `rpm -q cri-o` on the RHEL worker nodes to confirm the version of the `cri-o` package.

The current expectation is that RHCOS and RHEL are using the same 1.17 version of `cri-o`.

Closing as NOTABBUG; please re-open if you can confirm the RHEL nodes have a different `cri-o` RPM installed.

Comment 3 Yang Yang 2020-04-09 01:42:42 UTC
The RHEL actually requires cri-o 1.18 but the 1.18 build is not available yet. We have a bz against release, please check out Bug 1821567 - cri-o-1.18 required by AOS4.5 RHEL scaleup is not found.

Re-opening it. We can close it if RHEL reverts to 1.17.

Comment 4 Micah Abbott 2020-04-09 13:35:24 UTC
Changing this to low pri/sev because it should be pretty obvious when the 1.18 builds are available and RHCOS should pick them up automagically.

Comment 5 Yang Yang 2020-04-22 07:14:43 UTC
Install a cluster with 4.5.0-0.nightly-2020-04-21-040933.
# oc get node -o wide
NAME                                             STATUS   ROLES    AGE   VERSION        INTERNAL-IP   EXTERNAL-IP   OS-IMAGE                                                       KERNEL-VERSION                CONTAINER-RUNTIME
yanyan-n4b5h-m-0.c.openshift-qe.internal         Ready    master   24h   v1.18.0-rc.1   10.0.0.5                    Red Hat Enterprise Linux CoreOS 45.81.202004210032-0 (Ootpa)   4.18.0-147.8.1.el8_1.x86_64   cri-o://1.18.0-3.dev.rhaos4.5.git2cef6c3.el8-rc2

RHCOS installs 1.18 build hence move it to verified state.

Comment 7 errata-xmlrpc 2020-07-13 17:26:08 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:2409


Note You need to log in before you can comment on or make changes to this bug.