Bug 1999018
| Summary: | [ASH] upgrade stuck due to Cluster cloud controller manager deployment strategy error | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Milind Yadav <miyadav> |
| Component: | Cloud Compute | Assignee: | Joel Speed <jspeed> |
| Cloud Compute sub component: | Cloud Controller Manager | QA Contact: | sunzhaohua <zhsun> |
| Status: | CLOSED ERRATA | Docs Contact: | |
| Severity: | high | ||
| Priority: | urgent | CC: | aos-bugs, dhellmann, jhou, jspeed, mifiedle, otuchfel, scuppett, stbenjam, wking |
| Version: | 4.9 | Keywords: | TestBlocker |
| Target Milestone: | --- | ||
| Target Release: | 4.9.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | 1997507 | Environment: |
job=periodic-ci-openshift-release-master-ci-4.9-e2e-aws-upgrade-single-node=all
job=periodic-ci-openshift-release-master-ci-4.9-e2e-azure-upgrade-single-node=all
|
| Last Closed: | 2021-10-18 17:49:46 UTC | Type: | --- |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Comment 4
sunzhaohua
2021-09-02 01:26:45 UTC
Mike Fiedler added UpgradeBlocker, which triggers the following (delayed, sorry :/) impact-statement request: We're asking the following questions to evaluate whether or not this bug warrants blocking an upgrade edge from either the previous X.Y or X.Y.Z. The ultimate goal is to avoid delivering an update which introduces new risk or reduces cluster functionality in any way. Sample answers are provided to give more context and the ImpactStatementRequested label has been added to this bug. When responding, please remove ImpactStatementRequested and set the ImpactStatementProposed label. The expectation is that the assignee answers these questions. Who is impacted? If we have to block upgrade edges based on this issue, which edges would need blocking? * example: Customers upgrading from 4.y.Z to 4.y+1.z running on GCP with thousands of namespaces, approximately 5% of the subscribed fleet * example: All customers upgrading from 4.y.z to 4.y+1.z fail approximately 10% of the time What is the impact? Is it serious enough to warrant blocking edges? * example: Up to 2 minute disruption in edge routing * example: Up to 90 seconds of API downtime * example: etcd loses quorum and you have to restore from backup How involved is remediation (even moderately serious impacts might be acceptable if they are easy to mitigate)? * example: Issue resolves itself after five minutes * example: Admin uses oc to fix things * example: Admin must SSH to hosts, restore from backups, or other non standard admin activities Is this a regression (if all previous versions were also vulnerable, updating to the new, vulnerable version does not increase exposure)? * example: No, it has always been like this we just never noticed * example: Yes, from 4.y.z to 4.y+1.z Or 4.y.z to 4.y.z+1 > Who is impacted? If we have to block upgrade edges based on this issue, which edges would need blocking? Anyone using SNO would be impacted > What is the impact? Is it serious enough to warrant blocking edges? The issue would be if someone upgraded from 4.8 to 4.9 on SNO, it would have blocked the upgrade completely. As SNO was TP in 4.8, I don't think we will actually have any SNO upgrades. As this is in 4.9.0 there should be no issues with edge blocking. > How involved is remediation (even moderately serious impacts might be acceptable if they are easy to mitigate)? User must edit the `cluster-cloud-controller-manager-operator` deployment to update the strategy manually. > Is this a regression (if all previous versions were also vulnerable, updating to the new, vulnerable version does not increase exposure)? No, this has always been like this. The issue was noticed now that someone has tried an SNO upgrade. As far as I'm aware, SNO isn't GA until 4.9 anyway so this shouldn't be an issue (In reply to Joel Speed from comment #6) > The issue would be if someone upgraded from 4.8 to 4.9 on SNO, it would have > blocked the upgrade completely. > As SNO was TP in 4.8, I don't think we will actually have any SNO upgrades. > As this is in 4.9.0 there should be no issues with edge blocking. Makes sense to me. I'm dropping UpgradeBlocker, because we don't need to block edges in graph-data over this. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Moderate: OpenShift Container Platform 4.9.0 bug fix and security update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2021:3759 |