Bug 1708262

Summary:	Installer abuses AWS API quota
Product:	OpenShift Container Platform	Reporter:	Jan Safranek <jsafrane>
Component:	Installer	Assignee:	Abhinav Dahiya <adahiya>
Installer sub component:	openshift-installer	QA Contact:	Johnny Liu <jialiu>
Status:	CLOSED NOTABUG	Docs Contact:
Severity:	high
Priority:	unspecified	CC:	calfonso
Version:	4.1.0
Target Milestone:	---
Target Release:	4.2.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-07-03 00:55:43 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Jan Safranek 2019-05-09 13:24:29 UTC

Our shared AWS account hits AWS API quota pretty hard and because of that storage e2e tests flake. See bug #1704356.

AWS has one quota for whole account and we found out that it's installer who eats the most of API quota, almost twice as actual OpenShift. See https://bugzilla.redhat.com/show_bug.cgi?id=1704356#c13 for exact stats.

Installer should not be so heavy on AWS API usage and use longer delays and exponential backoff between retries where it makes sense.

Comment 1 Abhinav Dahiya 2019-07-03 00:55:43 UTC

The installer already has exponential back-offs and we are not going to take a hit on time taken to create a cluster to be nice to other e2e tests. every body should be backing off.