Created attachment 1789119 [details] noobaa diagnostic Description of problem: cluster is running for a while, there is 2 osds down, and noobaa-db-pg-0 pod is in "Terminating" status. unable to delete this pod Version-Release number of selected component (if applicable): ocs-operator.v4.8.0-402.ci Server Version: 4.8.0-0.nightly-2021-05-25-041803 Kubernetes Version: v1.21.0-rc.0+ee60d07 How reproducible: not sure how to reproduce. cluster is running for a while, and some steps in order to setup rbd-rbd mirroring done already. (here: https://red-hat-storage.github.io/ocs-training/RegionalDR/manual/ocs4-multisite-replication.html#_configuring_rbd_mirroring_between_odf_clusters 1.2, 1.3) nodes status: $ oc get nodes NAME STATUS ROLES AGE VERSION compute-0 Ready worker 12d v1.21.0-rc.0+ee60d07 compute-1 Ready worker 12d v1.21.0-rc.0+ee60d07 compute-2 Ready worker 12d v1.21.0-rc.0+ee60d07 control-plane-0 Ready master 12d v1.21.0-rc.0+ee60d07 control-plane-1 Ready master 12d v1.21.0-rc.0+ee60d07 control-plane-2 Ready master 12d v1.21.0-rc.0+ee60d07 Additional info: attaching: ocs must-gather, noobaa diagnostic must-gather: https://drive.google.com/file/d/1U33V3xQvM9ZQ9c9bwRM2CkOOMQG4SwPW/view?usp=sharing
root cause is here: https://bugzilla.redhat.com/show_bug.cgi?id=1434709 https://github.com/kubernetes/kubernetes/issues/45679#issuecomment-301365878 this bz can be closed