Bug 2026098 - 100% of the cco-metrics/cco-metrics targets in openshift-cloud-credential-operator namespace are down
Summary: 100% of the cco-metrics/cco-metrics targets in openshift-cloud-credential-ope...
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Cloud Credential Operator
Version: 4.6
Hardware: Unspecified
OS: Unspecified
Target Milestone: ---
: 4.8.z
Assignee: Akhil Rane
QA Contact: wang lin
Depends On: 2015989
Blocks: 2027750
TreeView+ depends on / blocked
Reported: 2021-11-23 18:34 UTC by OpenShift BugZilla Robot
Modified: 2021-12-07 06:39 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Last Closed: 2021-12-07 06:38:42 UTC
Target Upstream Version:

Attachments (Terms of Use)

System ID Private Priority Status Summary Last Updated
Github openshift cloud-credential-operator pull 425 0 None open [release-4.8] [release-4.9] Bug 2026098: Check for aws status in infra platform status field before client setup 2021-11-23 18:36:10 UTC
Red Hat Product Errata RHBA-2021:4881 0 None None None 2021-12-07 06:39:04 UTC

Comment 1 wang lin 2021-11-24 05:57:13 UTC
Verified on cluster-bot image with the PR merged

1. Install a baremetal cluster which doesn't have secretannotator implement on 4.8

2. Create an aws root secret and check cco pod, it won't crash

Reproduce the issue with a payload 4.8.0-0.nightly-2021-11-23-004954 without the PR merged

1. Install a baremetal cluster

2. Create an aws root secret and check cco pod, cco pod will crash like below:
E1124 05:49:03.539590       1 runtime.go:78] Observed a panic: "invalid memory address or nil pointer dereference" (runtime error: invalid memory address or nil pointer dereference)
goroutine 1508 [running]:
k8s.io/apimachinery/pkg/util/runtime.logPanic(0x205fb40, 0x3699dc0)
	/go/src/github.com/openshift/cloud-credential-operator/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:74 +0xa6
k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
	/go/src/github.com/openshift/cloud-credential-operator/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:48 +0x86
panic(0x205fb40, 0x3699dc0)
	/usr/lib/golang/src/runtime/panic.go:965 +0x1b9
github.com/openshift/cloud-credential-operator/pkg/operator/utils/aws.setupClientParams(0xc0004fa800, 0xc0006ae750)
	/go/src/github.com/openshift/cloud-credential-operator/pkg/operator/utils/aws/utils.go:45 +0x10f
github.com/openshift/cloud-credential-operator/pkg/operator/utils/aws.ClientBuilder(0xc003e1e048, 0x14, 0x14, 0xc003e18000, 0x28, 0x28, 0x274b8d0, 0xc0006ae750, 0x0, 0x0, ...)
	/go/src/github.com/openshift/cloud-credential-operator/pkg/operator/utils/aws/utils.go:29 +0x65
github.com/openshift/cloud-credential-operator/pkg/operator/secretannotator/aws.(*ReconcileCloudCredSecret).validateCloudCredsSecret(0xc0008a5d70, 0xc001b8e280, 0x1, 0x1)

Comment 5 errata-xmlrpc 2021-12-07 06:38:42 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.8.23 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.