Bug 2275456 - After upgrade, old csv ocs-operator.v4.15.2-rhodf is in failed state due to conflicting CRD owner in namespace
Summary: After upgrade, old csv ocs-operator.v4.15.2-rhodf is in failed state due to ...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenShift Data Foundation
Classification: Red Hat Storage
Component: odf-operator
Version: 4.16
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: ODF 4.16.0
Assignee: Nitin Goyal
QA Contact: Vijay Avuthu
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2024-04-17 09:16 UTC by Vijay Avuthu
Modified: 2024-07-17 13:19 UTC (History)
4 users (show)

Fixed In Version: 4.16.0-81
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2024-07-17 13:19:42 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github red-hat-storage ocs-operator pull 2565 0 None open bundle: add rook as a dependency to allow upgrades from 4.15 to 4.16 2024-04-18 05:34:40 UTC
Github red-hat-storage ocs-operator pull 2567 0 None open Bug 2275456:[release-4.16] bundle: add rook as a dependency to allow upgrades from 4.15 to 4.16 2024-04-18 08:15:27 UTC
Github red-hat-storage odf-operator pull 399 0 None open bundle: remove rook as a dependency to allow upgrades from 4.15 to 4.16 2024-04-18 05:34:40 UTC
Github red-hat-storage odf-operator pull 400 0 None open Bug 2275456:[release-4.16] bundle: remove rook as a dependency to allow upgrades from 4.15 to 4.16 2024-04-18 10:18:12 UTC
Red Hat Product Errata RHSA-2024:4591 0 None None None 2024-07-17 13:19:46 UTC

Description Vijay Avuthu 2024-04-17 09:16:23 UTC
Description of problem (please be detailed as possible and provide log
snippests):

After upgrading cluster from 4.15.1 ( GA'ed ) to 4.16.0-78, old csv ocs-operator.v4.15.2-rhodf is not removed.


Version of all relevant components (if applicable):
openshift installer (4.16.0-0.nightly-2024-04-16-195622)
cluster upgraded from 4.15.1 ( GA'ed ) to 4.16.0-78

Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?
No

Is there any workaround available to the best of your knowledge?
NA

Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?
1

Can this issue reproducible?
1/1

Can this issue reproduce from the UI?
Not tried

If this is a regression, please provide more details to justify this:


Steps to Reproduce:
1. install odf 4.15.1 ( GA'ed ) using ocs-ci
2. upgrade to 4.16.0-78 using ocs-ci
3. check all CSV's


Actual results:

$ oc get csv
NAME                                        DISPLAY                            VERSION            REPLACES                                PHASE
mcg-operator.v4.16.0-78.stable              NooBaa Operator                    4.16.0-78.stable   mcg-operator.v4.15.2-rhodf              Succeeded
ocs-client-operator.v4.16.0-78.stable       OpenShift Data Foundation Client   4.16.0-78.stable                                           Succeeded
ocs-operator.v4.15.2-rhodf                  OpenShift Container Storage        4.15.2-rhodf       ocs-operator.v4.15.1-rhodf              Failed
ocs-operator.v4.16.0-78.stable              OpenShift Container Storage        4.16.0-78.stable   ocs-operator.v4.15.2-rhodf              Succeeded
odf-csi-addons-operator.v4.16.0-78.stable   CSI Addons                         4.16.0-78.stable   odf-csi-addons-operator.v4.15.2-rhodf   Succeeded
odf-operator.v4.16.0-78.stable              OpenShift Data Foundation          4.16.0-78.stable   odf-operator.v4.15.1-rhodf              Succeeded
odf-prometheus-operator.v4.16.0-78.stable   Prometheus Operator                4.16.0-78.stable                                           Succeeded
rook-ceph-operator.v4.16.0-78.stable        Rook-Ceph                          4.16.0-78.stable                                           Succeeded




Expected results:

old CSV's  should be removed


Additional info:

>  $ oc describe csv ocs-operator.v4.15.2-rhodf
.
.
.
Events:
  Type     Reason               Age                      From                        Message
  ----     ------               ----                     ----                        -------
  Normal   RequirementsUnknown  142m                     operator-lifecycle-manager  requirements not yet checked
  Normal   RequirementsNotMet   142m                     operator-lifecycle-manager  one or more requirements couldn't be found
  Warning  OwnerConflict        2m21s (x2769 over 142m)  operator-lifecycle-manager  conflicting CRD owner in namespace
  Normal   NeedsReinstall       2m18s (x2851 over 142m)  operator-lifecycle-manager  installing: missing deployment with name=ocs-operator

job: https://url.corp.redhat.com/68b9fe5
must gather: https://url.corp.redhat.com/082baaa

Comment 7 Vijay Avuthu 2024-04-22 12:24:34 UTC
tested with  4.16.0-83.stable

> CSV status after upgrade

 $ oc get csv
NAME                                        DISPLAY                            VERSION            REPLACES                                PHASE
mcg-operator.v4.16.0-83.stable              NooBaa Operator                    4.16.0-83.stable   mcg-operator.v4.15.2-rhodf              Succeeded
ocs-client-operator.v4.16.0-83.stable       OpenShift Data Foundation Client   4.16.0-83.stable                                           Succeeded
ocs-operator.v4.15.2-rhodf                  OpenShift Container Storage        4.15.2-rhodf       ocs-operator.v4.15.1-rhodf              Failed
ocs-operator.v4.16.0-83.stable              OpenShift Container Storage        4.16.0-83.stable   ocs-operator.v4.15.2-rhodf              Succeeded
odf-csi-addons-operator.v4.16.0-83.stable   CSI Addons                         4.16.0-83.stable   odf-csi-addons-operator.v4.15.2-rhodf   Succeeded
odf-operator.v4.16.0-83.stable              OpenShift Data Foundation          4.16.0-83.stable   odf-operator.v4.15.1-rhodf              Succeeded
odf-prometheus-operator.v4.16.0-83.stable   Prometheus Operator                4.16.0-83.stable                                           Succeeded
rook-ceph-operator.v4.16.0-83.stable        Rook-Ceph                          4.16.0-83.stable                                           Succeeded


> 

$ oc describe csv ocs-operator.v4.15.2-rhodf 
.
.
.
Events:
  Type     Reason               Age                  From                        Message
  ----     ------               ----                 ----                        -------
  Normal   RequirementsUnknown  31m                  operator-lifecycle-manager  requirements not yet checked
  Normal   RequirementsNotMet   31m                  operator-lifecycle-manager  one or more requirements couldn't be found
  Warning  OwnerConflict        72s (x395 over 31m)  operator-lifecycle-manager  conflicting CRD owner in namespace
  Normal   NeedsReinstall       67s (x409 over 31m)  operator-lifecycle-manager  installing: missing deployment with name=ocs-operator

job:  https://url.corp.redhat.com/6935f8a
must gather: https://url.corp.redhat.com/42ef474

Comment 11 Vijay Avuthu 2024-04-23 12:39:01 UTC
moving to Verify as per comment #8 and comment #9

Comment 13 errata-xmlrpc 2024-07-17 13:19:42 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: Red Hat OpenShift Data Foundation 4.16.0 security, enhancement & bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2024:4591


Note You need to log in before you can comment on or make changes to this bug.