Bug 1746524

Summary:	4.1.13 -> 4.2.0-0.nightly-2019-08-28-083236 upgrade stuck on image-registry certificate error
Product:	OpenShift Container Platform	Reporter:	Mike Fiedler <mifiedle>
Component:	Image Registry	Assignee:	Oleg Bulatov <obulatov>
Status:	CLOSED DUPLICATE	QA Contact:	Wenjing Zheng <wzheng>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	4.2.0	CC:	adam.kaplan, aos-bugs
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-08-28 19:38:00 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Mike Fiedler 2019-08-28 16:46:16 UTC

Description of problem:

4.1.13 -> 4.2.0-0.nightly-2019-08-28-083236 upgrade got stuck on with the image-registry operator stuck in Progressing with the following errors repeated forever in the image-registry-operator log every 3 minutes:

# oc logs -n openshift-image-registry cluster-image-registry-operator-786cc6b5d7-92r24 -c cluster-image-registry-operator | tail -15
caused by: Head https://image-registry-us-west-2-3a31bbf4774440798a715e665697a190-1314.s3.us-west-2.amazonaws.com/: x509: certificate signed by unknown authority, requeuing
E0828 16:43:06.523523       1 controller.go:257] unable to sync: unable to sync storage configuration: RequestError: send request failed
caused by: Head https://image-registry-us-west-2-3a31bbf4774440798a715e665697a190-1314.s3.us-west-2.amazonaws.com/: x509: certificate signed by unknown authority, requeuing
E0828 16:43:09.595666       1 controller.go:257] unable to sync: unable to sync storage configuration: RequestError: send request failed
caused by: Head https://image-registry-us-west-2-3a31bbf4774440798a715e665697a190-1314.s3.us-west-2.amazonaws.com/: x509: certificate signed by unknown authority, requeuing
E0828 16:43:12.583055       1 controller.go:257] unable to sync: unable to sync storage configuration: RequestError: send request failed
caused by: Head https://image-registry-us-west-2-3a31bbf4774440798a715e665697a190-1314.s3.us-west-2.amazonaws.com/: x509: certificate signed by unknown authority, requeuing
E0828 16:43:15.606375       1 controller.go:257] unable to sync: unable to sync storage configuration: RequestError: send request failed
caused by: Head https://image-registry-us-west-2-3a31bbf4774440798a715e665697a190-1314.s3.us-west-2.amazonaws.com/: x509: certificate signed by unknown authority, requeuing
E0828 16:43:18.568112       1 controller.go:257] unable to sync: unable to sync storage configuration: RequestError: send request failed
caused by: Head https://image-registry-us-west-2-
 


Version-Release number of selected component (if applicable):  4.1.13 -> 4.2.0-0.nightly-2019-08-28-083236 


How reproducible: unknown - once so far


Steps to Reproduce:
1.  Upgrade 4.1.13 -> 4.2.0-0.nightly-2019-08-28-083236  on a cluster with 200 projects.   Each project has:

- 1 buildconfig
- 15 builds
- 10 imagestreams
- 1 deployment
- 20 secrets

Additional info:  oc adm must-gather location will be added

Comment 2 Adam Kaplan 2019-08-28 19:38:00 UTC


*** This bug has been marked as a duplicate of bug 1746155 ***