Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1890667

Summary: [4.6.z] s390x: Generate new ostree rpm with fix for rootfs immutability
Product: OpenShift Container Platform Reporter: Micah Abbott <miabbott>
Component: RHCOSAssignee: Colin Walters <walters>
Status: CLOSED ERRATA QA Contact: Michael Nguyen <mnguyen>
Severity: medium Docs Contact:
Priority: high    
Version: 4.6CC: bbreard, imcleod, jligon, mnguyen, nstielau, psundara, walters
Target Milestone: ---   
Target Release: 4.6.z   
Hardware: s390x   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1890361
: 1890668 (view as bug list) Environment:
Last Closed: 2020-11-09 15:50:59 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1890361    
Bug Blocks: 1890668    

Description Micah Abbott 2020-10-22 16:55:40 UTC
+++ This bug was initially created as a clone of Bug #1890361 +++

Recently the s390x 4.5 RHCOS pipeline started failing because the ostree version of fedora32 which is used in the cosa container had the fix for 

https://bugzilla.redhat.com/show_bug.cgi?id=1867601

Because of this - the root file system is immutable - which is good, but the ostree version in RHCOS 4.5 is an older version which does not have the fix for the above BZ. This causes rollbacks and upgrades to fail.

For now, the coreos-assembler is patched to remove the immutable bit, but it would be good if ostree is bumped with the fix for RHCOS 4.5.

--- Additional comment from Prashanth Sundararaman on 2020-10-22 01:30:18 UTC ---

This is the said fix that would need to be backported:

https://github.com/ostreedev/ostree/pull/2179

--- Additional comment from Micah Abbott on 2020-10-22 16:54:49 UTC ---

Targeting 4.7 (though the fix should already be present there and in 4.6); we will probably need to clone this for 4.5.z

Comment 1 Micah Abbott 2020-10-25 18:37:43 UTC
This was fixed in ostree-2020.5-4.el8 which is already included in RHCOS 4.6

Comment 4 Michael Nguyen 2020-10-30 15:24:34 UTC
$ oc get clusterversion
NAME      VERSION                             AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.6.0-0.nightly-2020-10-28-101609   True        False         40m     Cluster version is 4.6.0-0.nightly-2020-10-28-101609
$ oc get nodes
NAME                                         STATUS   ROLES    AGE   VERSION
ip-10-0-130-137.us-west-2.compute.internal   Ready    master   60m   v1.19.0+d59ce34
ip-10-0-154-89.us-west-2.compute.internal    Ready    worker   51m   v1.19.0+d59ce34
ip-10-0-164-132.us-west-2.compute.internal   Ready    master   59m   v1.19.0+d59ce34
ip-10-0-170-31.us-west-2.compute.internal    Ready    worker   51m   v1.19.0+d59ce34
ip-10-0-194-221.us-west-2.compute.internal   Ready    worker   51m   v1.19.0+d59ce34
ip-10-0-222-165.us-west-2.compute.internal   Ready    master   60m   v1.19.0+d59ce34
$ oc debug node/ip-10-0-130-137.us-west-2.compute.internal
Starting pod/ip-10-0-130-137us-west-2computeinternal-debug ...
To use host binaries, run `chroot /host`
If you don't see a command prompt, try pressing enter.
sh-4.2# chroot /host
sh-4.4# rpm -q  ostree              
ostree-2020.5-4.el8.x86_64
sh-4.4#

Comment 6 errata-xmlrpc 2020-11-09 15:50:59 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6.3 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4339