Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1809764

Summary: installer: Failed to remove AWS s3 bucket on uninstall
Product: OpenShift Container Platform Reporter: Cesar Wong <cewong>
Component: InstallerAssignee: Abhinav Dahiya <adahiya>
Installer sub component: openshift-installer QA Contact: Johnny Liu <jialiu>
Status: CLOSED INSUFFICIENT_DATA Docs Contact:
Severity: medium    
Priority: medium CC: dgoodwin
Version: 4.2.z   
Target Milestone: ---   
Target Release: 4.5.0   
Hardware: All   
OS: All   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-03-11 12:20:26 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Cesar Wong 2020-03-03 20:25:22 UTC
Description of problem:
Uninstall fails because the uninstaller cannot remove a bucket

Version-Release number of selected component (if applicable):
4.2 release - SHA 6fdffbb9c21d90ba97fc79dff3ccbeac22fb2a0e

How reproducible:
Happening on a dedicated instance in production

Steps to Reproduce:
1. Uninstall cluster

Actual results:
Uninstaller stuck with the following repeating log:
time="2020-03-03T02:03:24Z" level=debug msg="search for and delete matching resources by tag in eu-central-1 matching aws.Filter{\"kubernetes.io/cluster/gigabit-rh-01-dc4s7\":\"owned\"}"
time="2020-03-03T02:03:25Z" level=debug msg=Emptied arn="arn:aws:s3:::gigabit-rh-01-dc4s7-image-registry-eu-central-1-rvrlyxmkxgcgug"
time="2020-03-03T02:03:25Z" level=debug msg="BucketNotEmpty: The bucket you tried to delete is not empty. You must delete all versions in the bucket.\n\tstatus code: 409, request id: 12E69E53086387F3, host id: WvYBTig6Xc03tIEVkGDYKELDvB1S5TH3YF+3npJMtfnHRHOMupCzrl8WYbsf2Ng1gtqbwfnx1X4=" arn="arn:aws:s3:::gigabit-rh-01-dc4s7-image-registry-eu-central-1-rvrlyxmkxgcgug"

Expected results:
Uninstall completes successfully

Additional info:

Comment 1 Scott Dodson 2020-03-04 18:38:24 UTC
Cesar,

Can you tell us what's inside the bucket after the failed removal?

Comment 3 Cesar Wong 2020-03-11 12:19:55 UTC
Unable to get additional information about this instance. Will close and open a new one if we see this again.