Bug 1838810

Summary:	the read-only CR cannot be reconciled after removing the root cloud creds
Product:	OpenShift Container Platform	Reporter:	OpenShift BugZilla Robot <openshift-bugzilla-robot>
Component:	Cloud Credential Operator	Assignee:	Joel Diaz <jdiaz>
Status:	CLOSED ERRATA	QA Contact:	wang lin <lwan>
Severity:	high	Docs Contact:
Priority:	high
Version:	4.5	CC:	dgoodwin, knewcome, lwan, ngreen
Target Milestone:	---
Target Release:	4.4.z
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:	Cause: The cloud-credential-operator had special-case handling for the CCO's own read-only CredentialsRequest CR that required the existence of the cloud root creds. Consequence: If the cloud root creds are missing, CCO would be unable to reconcile CCO's own read-only CredentialsRequest CR. Fix: Use the read-only CredentialsRequest credentials to validate the read-only CredentialsRequest just like every other CredentialsRequest. Result: Removing the cloud root creds doesn't put CCO into a degraded state.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2020-06-17 22:26:36 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1838718
Bug Blocks:

Description OpenShift BugZilla Robot 2020-05-21 20:26:39 UTC

+++ This bug was initially created as a clone of Bug #1838718 +++

Description of problem:
After removing the root cloud credentials secret (eg kube-system/aws-creds), when the cloud-credential-operator goes to re-reconcile the read-only creds (cloud-credential-operator-iam-ro), it fails b/c it cannot find the root credentials (which of course were previously deleted).

Version-Release number of selected component (if applicable):

4.4.4


How reproducible: 100%


Steps to Reproduce:
1. Install OpenShift 4.4.4 on AWS
2. Delete the secret kube-system/aws-creds
3. Wait for CCO to reconcile the read-only CR

Actual results:

CCO will fail to reconcile the read-only credentials.


Expected results:

CCO doesn't enter an error state (where not all credentials have been successfully reconciled) when the root creds are removed.


Additional info:

Comment 2 Scott Dodson 2020-06-02 17:53:40 UTC

This was bumped to high because this is blocking a customer deployment.

Comment 5 wang lin 2020-06-08 09:41:17 UTC

The bug has been fixed.
The test payload is 4.4.0-0.nightly-2020-06-07-075345

The result is as below:
1.Install OpenShift on AWS
2.wait for cco reconcile (it is about 6 hours)
3.The cco successes to reconcile the read-only credentials and don't Degraded

$ oc get co cloud-credential
NAME               VERSION                             AVAILABLE   PROGRESSING   DEGRADED   SINCE
cloud-credential   4.4.0-0.nightly-2020-06-07-075345   True        False         False      8h

Comment 7 errata-xmlrpc 2020-06-17 22:26:36 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:2445