Bug 2099530 - openshift-storage namespace stuck in terminating state.
Summary: openshift-storage namespace stuck in terminating state.
Keywords:
Status: NEW
Alias: None
Product: Red Hat OpenShift Container Storage
Classification: Red Hat Storage
Component: ocs-operator
Version: unspecified
Hardware: All
OS: All
unspecified
medium
Target Milestone: ---
: ---
Assignee: Nobody
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-06-21 07:48 UTC by pmali
Modified: 2023-08-03 08:30 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Embargoed:


Attachments (Terms of Use)

Description pmali 2022-06-21 07:48:32 UTC
Description of problem:
When I tried to delete openshift-storage namespace, its stuck in terminating state.

Version-Release number of selected component (if applicable):

$ oc get clusterversion
NAME      VERSION                              AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.11.0-0.nightly-2022-06-15-222801   True        False         4h27m   Cluster version is 4.11.0-0.nightly-2022-06-15-222801

Environment :

ipi-on-aws

vm_rootvolume_masters:
  size: 768
vm_rootvolume_workers:
  size: 768
vm_type: m5.2xlarge

How reproducible:

Steps to Reproduce:
1. Install and Configure ODF  (https://red-hat-storage.github.io/ocs-training/training/ocs4/ocs.html)
2. Delete odf operator from GUI
3. Delete openshift-storage namespace

Actual results:

$ oc get ns |grep openshift-storage
openshift-storage                                  Terminating   92m


Expected results:
namespace should be deleted.

Additional info:

As a workaround I have tried below steps to delete ns and it worked.

https://www.redhat.com/sysadmin/openshift-terminating-state


Snip from commad output :

$ oc get ns openshift-storage -oyaml 
apiVersion: v1
kind: Namespace
metadata:
  annotations:
    openshift.io/sa.scc.mcs: s0:c27,c4
    openshift.io/sa.scc.supplemental-groups: 1000710000/10000
    openshift.io/sa.scc.uid-range: 1000710000/10000
  creationTimestamp: "2022-06-21T06:09:10Z"
  deletionTimestamp: "2022-06-21T07:33:40Z"
  labels:
    kubernetes.io/metadata.name: openshift-storage
  name: openshift-storage
  resourceVersion: "338621"
  uid: 344f1b62-a9fb-466d-b9e3-1ae58535e2cc
spec:
  finalizers:
  - kubernetes
status:
  conditions:
  - lastTransitionTime: "2022-06-21T07:33:52Z"
    message: All resources successfully discovered
    reason: ResourcesDiscovered
    status: "False"
    type: NamespaceDeletionDiscoveryFailure
  - lastTransitionTime: "2022-06-21T07:33:52Z"
    message: All legacy kube types successfully parsed
    reason: ParsedGroupVersions
    status: "False"
    type: NamespaceDeletionGroupVersionParsingFailure
  - lastTransitionTime: "2022-06-21T07:34:14Z"
    message: 'Failed to delete all resource types, 1 remaining: unexpected items still
      remain in namespace: openshift-storage for gvr: /v1, Resource=pods'
    reason: ContentDeletionFailed
    status: "True"
    type: NamespaceDeletionContentFailure
  - lastTransitionTime: "2022-06-21T07:33:52Z"
    message: 'Some resources are remaining: cephblockpools.ceph.rook.io has 1 resource
      instances, cephclusters.ceph.rook.io has 1 resource instances, cephfilesystems.ceph.rook.io
      has 1 resource instances, configmaps. has 1 resource instances, persistentvolumeclaims.
      has 1 resource instances, pods. has 1 resource instances, secrets. has 1 resource
      instances, storageclusters.ocs.openshift.io has 1 resource instances, storagesystems.odf.openshift.io
      has 1 resource instances'
    reason: SomeResourcesRemain
    status: "True"
    type: NamespaceContentRemaining
  - lastTransitionTime: "2022-06-21T07:33:52Z"
    message: 'Some content in the namespace has finalizers remaining: ceph.rook.io/disaster-protection
      in 2 resource instances, cephblockpool.ceph.rook.io in 1 resource instances,
      cephcluster.ceph.rook.io in 1 resource instances, cephfilesystem.ceph.rook.io
      in 1 resource instances, kubernetes.io/pvc-protection in 1 resource instances,
      storagecluster.ocs.openshift.io in 1 resource instances, storagesystem.odf.openshift.io
      in 1 resource instances'
    reason: SomeFinalizersRemain
    status: "True"
    type: NamespaceFinalizersRemaining
  phase: Terminating

Comment 1 Jan Safranek 2022-06-21 10:45:48 UTC
Moving to ODF, openshift-storage is their namespace.


Note You need to log in before you can comment on or make changes to this bug.