Bug 2283029

Summary: Uninstall KCS instructions do not work for ODF 4.16
Product: [Red Hat Storage] Red Hat OpenShift Data Foundation Reporter: Annette Clewett <aclewett>
Component: ocs-client-operatorAssignee: Madhu Rajanna <mrajanna>
Status: CLOSED DUPLICATE QA Contact: Neha Berry <nberry>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 4.16CC: lgangava, muagarwa, odf-bz-bot, omitrani
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2024-09-13 03:07:09 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Annette Clewett 2024-05-23 17:20:34 UTC 
Describe the issue:

KCS for uninstalling ODF, https://access.redhat.com/articles/6525111, fails to delete openshift-storage project and additional manual cleanup is required. 

Uninstall for ODF 4.16 (build 102) after removing all DR config and verifying no obc or pvc exist (except those for ceph storagecluster).

% oc get storagecluster
NAME                 AGE   PHASE   EXTERNAL   CREATED AT             VERSION
ocs-storagecluster   14d   Ready              2024-05-08T17:35:54Z   4.16.0

% oc get noobaa
NAME     S3-ENDPOINTS                    STS-ENDPOINTS                   SYSLOG-ENDPOINTS   IMAGE                                                                                                            PHASE   AGE
noobaa   ["https://10.11.82.76:31475"]   ["https://10.11.82.76:30119"]                      registry.redhat.io/odf4/mcg-core-rhel9@sha256:313739c72ce84a82b9ed6064747c4cbb2d069bd0f0479750293b0260eace675b   Ready   14d
% oc annotate storagecluster -n openshift-storage ocs-storagecluster uninstall.ocs.openshift.io/mode="forced" --overwrite
storagecluster.ocs.openshift.io/ocs-storagecluster annotated

% oc get pvc -A
NAMESPACE           NAME                          STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                  VOLUMEATTRIBUTESCLASS   AGE
openshift-storage   db-noobaa-db-pg-0             Bound    pvc-a523dd39-7b3a-40c9-848a-fa36f984be00   50Gi       RWO            ocs-storagecluster-ceph-rbd   <unset>                 14d
openshift-storage   ocs-deviceset-0-data-0zlm2c   Bound    pvc-9322ded9-43b7-455e-879e-b6eaba815d6a   100Gi      RWO            thin-csi                      <unset>                 14d
openshift-storage   ocs-deviceset-1-data-0lxpl2   Bound    pvc-def40130-f45a-45c0-936e-909490f735f2   100Gi      RWO            thin-csi                      <unset>                 14d
openshift-storage   ocs-deviceset-2-data-0tgx4c   Bound    pvc-ccecf08c-8a9e-4ae5-aabc-f5db31e36b48   100Gi      RWO            thin-csi                      <unset>                 14d

% oc delete -n openshift-storage storagesystem --all --wait=true
storagesystem.odf.openshift.io "ocs-storagecluster-storagesystem" deleted

% oc delete project openshift-storage
project.project.openshift.io "openshift-storage" deleted
[HANGS here and never deletes]

>>>Also, CRDs to be deleted are not complete. Need to add ALL additional CRDs to be removed given new 4.16 (and 4.15) CRs.

Describe the task you were trying to accomplish:
Uninstall ODF 4.16 

Suggestions for improvement:
KCS instructions modified to include uninstall for ODF 4.16.

Document URL:
https://access.redhat.com/articles/6525111

Product Version: ODF 4.16 (build 102)

Environment Details: OCP 4.16 and ACM 2.10

Additional information:

Why is project not deleting?

% oc get project openshift-storage -o yaml
[...]
  - lastTransitionTime: "2024-05-23T15:58:30Z"
    message: All content successfully deleted, may be waiting on finalization
    reason: ContentDeleted
    status: "False"
    type: NamespaceDeletionContentFailure
  - lastTransitionTime: "2024-05-23T15:58:30Z"
    message: 'Some resources are remaining: configmaps. has 1 resource instances'
    reason: SomeResourcesRemain
    status: "True"
    type: NamespaceContentRemaining
  - lastTransitionTime: "2024-05-23T15:58:30Z"
    message: 'Some content in the namespace has finalizers remaining: ocs-client-operator.ocs.openshift.io/storageused
      in 1 resource instances'
    reason: SomeFinalizersRemain
    status: "True"
    type: NamespaceFinalizersRemaining
  phase: Terminating