Description of problem (please be detailed as possible and provide log snippests): upgrade failed from 4.9.8 to 4.10.4-2 with conflicting CRD owner in namespace and missing deployment with name=odf-operator-controller-manager Version of all relevant components (if applicable): openshift installer (4.10.0-0.nightly-2022-06-08-150219) upgrade from 4.9.8 to 4.10.4-2 Does this issue impact your ability to continue to work with the product (please explain in detail what is the user impact)? not able to upgrade Is there any workaround available to the best of your knowledge? No Rate from 1 - 5 the complexity of the scenario you performed that caused this bug (1 - very simple, 5 - very complex)? 1 Can this issue reproducible? 2/2 Can this issue reproduce from the UI? Not tried If this is a regression, please provide more details to justify this: Yes Steps to Reproduce: 1. install ocs 4.9.8 and upgrade to 4.10.4-2 2. 3. Actual results: 2022-06-21 10:42:35 05:12:35 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage get csv ocs-operator.v4.10.4 -n openshift-storage -o yaml 2022-06-21 10:42:35 05:12:35 - MainThread - ocs_ci.utility.utils - WARNING - Command stderr: Error from server (NotFound): clusterserviceversions.operators.coreos.com "ocs-operator.v4.10.4" not found 2022-06-21 10:42:35 2022-06-21 10:42:35 05:12:35 - MainThread - ocs_ci.ocs.ocp - WARNING - Failed to get resource: ocs-operator.v4.10.4 of kind: csv, selector: None, Error: Error during execution of command: oc -n openshift-storage get csv ocs-operator.v4.10.4 -n openshift-storage -o yaml. 2022-06-21 10:42:35 Error is Error from server (NotFound): clusterserviceversions.operators.coreos.com "ocs-operator.v4.10.4" not found $ oc get csv NAME DISPLAY VERSION REPLACES PHASE mcg-operator.v4.10.3 NooBaa Operator 4.10.3 mcg-operator.v4.10.2 Succeeded ocs-operator.v4.9.9 OpenShift Container Storage 4.9.9 ocs-operator.v4.9.8 Succeeded odf-csi-addons-operator.v4.10.4 CSI Addons 4.10.4 odf-csi-addons-operator.v4.10.3 Succeeded odf-operator.v4.10.4 OpenShift Data Foundation 4.10.4 odf-operator.v4.9.8 Failed odf-operator.v4.9.9 OpenShift Data Foundation 4.9.9 odf-operator.v4.9.8 Succeeded Expected results: odf-operator and ocs-operator should be in succeeded state Additional info: $ oc describe csv odf-operator.v4.10.4 Name: odf-operator.v4.10.4 Namespace: openshift-storage Labels: full_version=4.10.4-2 operatorframework.io/arch.amd64=supported operatorframework.io/arch.ppc64le=supported operatorframework.io/arch.s390x=supported operators.coreos.com/odf-operator.openshift-storage= Status: Cleanup: Conditions: Last Transition Time: 2022-06-21T05:26:20Z Last Update Time: 2022-06-21T05:26:20Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:20Z Last Update Time: 2022-06-21T05:26:20Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:20Z Last Update Time: 2022-06-21T05:26:20Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:20Z Last Update Time: 2022-06-21T05:26:20Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:21Z Last Update Time: 2022-06-21T05:26:21Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:22Z Last Update Time: 2022-06-21T05:26:22Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:23Z Last Update Time: 2022-06-21T05:26:23Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:23Z Last Update Time: 2022-06-21T05:26:23Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:23Z Last Update Time: 2022-06-21T05:26:23Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:25Z Last Update Time: 2022-06-21T05:26:25Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:25Z Last Update Time: 2022-06-21T05:26:25Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:26Z Last Update Time: 2022-06-21T05:26:26Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:26Z Last Update Time: 2022-06-21T05:26:26Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:28Z Last Update Time: 2022-06-21T05:26:28Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:28Z Last Update Time: 2022-06-21T05:26:28Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:29Z Last Update Time: 2022-06-21T05:26:29Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:29Z Last Update Time: 2022-06-21T05:26:29Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:30Z Last Update Time: 2022-06-21T05:26:30Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:31Z Last Update Time: 2022-06-21T05:26:31Z Message: installing: missing deployment with name=odf-operator-controller-manager Phase: Pending Reason: NeedsReinstall Last Transition Time: 2022-06-21T05:26:32Z Last Update Time: 2022-06-21T05:26:32Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Last Transition Time: 2022-06-21T05:26:32Z Last Update Time: 2022-06-21T05:26:32Z Message: conflicting CRD owner in namespace Phase: Failed Reason: OwnerConflict Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal RequirementsUnknown 53m operator-lifecycle-manager requirements not yet checked Normal RequirementsNotMet 53m operator-lifecycle-manager one or more requirements couldn't be found Warning OwnerConflict 23m (x4057 over 53m) operator-lifecycle-manager conflicting CRD owner in namespace Normal NeedsReinstall 3m31s (x7814 over 53m) operator-lifecycle-manager installing: missing deployment with name=odf-operator-controller-manager must gather logs: http://magna002.ceph.redhat.com/ocsci-jenkins/openshift-clusters/j-239vu1cs33-ua/j-239vu1cs33-ua_20220621T033059/logs/failed_testcase_ocs_logs_1655785124/test_upgrade_ocs_logs/
Closing it based on comment 6