Bug 1973018 - Ironic rhcos downloader breaks image cache in upgrade process from 4.7 to 4.8
Summary: Ironic rhcos downloader breaks image cache in upgrade process from 4.7 to 4.8
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Bare Metal Hardware Provisioning
Version: 4.8
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: ---
: 4.8.0
Assignee: Arda Guclu
QA Contact: Ori Michaeli
URL:
Whiteboard:
: 1974074 (view as bug list)
Depends On: 1972572
Blocks: 1974074
TreeView+ depends on / blocked
 
Reported: 2021-06-17 06:08 UTC by Arda Guclu
Modified: 2021-07-27 23:13 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-07-27 23:13:09 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift ironic-rhcos-downloader pull 51 0 None open [release-4.8] Bug 1973018: Fix image incompatibility between 4.7 and 4.8 while upgrade 2021-06-17 14:15:23 UTC
Red Hat Product Errata RHSA-2021:2438 0 None None None 2021-07-27 23:13:28 UTC

Description Arda Guclu 2021-06-17 06:08:38 UTC
Description of problem:
4.8 has image caching mechanism and 4.7 has not. Thus, these 2 versions are using different image paths but eventually they are using the same image. In upgrade process, ironic rhcos downloader does not know image exist and that's why, in any cases, it re-downloads same image.

This breaks symlinks and also delay the completion of upgrade process.

Version-Release number of selected component (if applicable):
4.8+

How reproducible:
Running e2e-metal-ipi-upgrade from 4.7 to 4.8 and checking metal3-machine-os-downloader container logs.

Actual results:
Symlinks of images are broken.

Expected results:
Symlinks are correctly aligned.

Comment 1 Steven Hardy 2021-06-17 14:22:50 UTC
I renamed this and increased the severity - initially we/I thought the image cache ended up broken only for the duration of the duplicate image download, but in fact when referring to the "old" 4.7 URL it's permanently broken due to the corruption of the symlinks.

As such this is a blocker I think, it means that all existing hosts will fail to adopt after upgrade, and scale-out will not work.

Comment 4 Ori Michaeli 2021-06-24 06:42:56 UTC
Verified with upgrade from 4.7.17 to 4.8.0-0.nightly-2021-06-22-022125

Comment 6 Zane Bitter 2021-06-28 13:54:05 UTC
*** Bug 1974074 has been marked as a duplicate of this bug. ***

Comment 8 errata-xmlrpc 2021-07-27 23:13:09 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.8.2 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:2438


Note You need to log in before you can comment on or make changes to this bug.