Bug 2002287

Summary: Deploying OCS 4.8.1 on OCP 4.9.0-rc.0 leads to incompatibility warning
Product: [Red Hat Storage] Red Hat OpenShift Data Foundation Reporter: daniel <dmoessne>
Component: ocs-operatorAssignee: Jose A. Rivera <jrivera>
Status: CLOSED DUPLICATE QA Contact: Raz Tamir <ratamir>
Severity: medium Docs Contact:
Priority: medium    
Version: 4.8CC: assingh, bkunal, branto, jrivera, madam, nibalach, ocs-bugs, odf-bz-bot, prpandey, sostapov, tdesala, uchapaga
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-09-22 22:07:58 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
screenshot none

Description daniel 2021-09-08 12:53:06 UTC 
Created attachment 1821521 [details]
screenshot

Description of problem (please be detailed as possible and provide log
snippests):

Installing OCS 4.8.1 on top of OCP 4.9.0-rc.0 leads to a warning:
~~~
ClusterNotUpgradeable
Warning

In most cases, you will still be able to apply patch releases. Reason IncompatibleOperatorsInstalled. For more information refer to 'oc adm upgrade' or https://console-openshift-console.apps.cluster.xxxxxxxxx/settings/cluster/
~~~
Checking there:

~~~
Warning alert:This cluster should not be updated to the next minor version.

Cluster operator operator-lifecycle-manager should not be upgraded between minor versions: ClusterServiceVersions blocking cluster upgrade: openshift-storage/ocs-operator.v4.8.1 is incompatible with OpenShift minor versions greater than 4.8
~~~

or on cli:
~~~
[root@bastion ~]# oc adm upgrade
Cluster version is 4.9.0-rc.0

Upgradeable=False

  Reason: IncompatibleOperatorsInstalled
  Message: Cluster operator operator-lifecycle-manager should not be upgraded between minor versions: ClusterServiceVersions blocking cluster upgrade: openshift-storage/ocs-operator.v4.8.1 is incompatible with OpenShift minor versions greater than 4.8

Upstream: https://openshift-release.apps.ci.l2s4.p1.openshiftapps.com/graph
Channel: stable-4.9
No updates available. You may force an upgrade to a specific release image, but doing so may not be supported and may result in downtime or data loss.
[root@bastion ~]# 

~~~

While I was under the impression we support n and n+1 and hence OCP 4.9 should be stupported 


Version of all relevant components (if applicable):
- OCP 4.9.0-rc.0
- OCS 4.8.1

Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?
No, it does not, still it is irritating

Is there any workaround available to the best of your knowledge?
nat that I am aware of 

Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?
1  (just installation, nothing else)

Is this issue reproducible?

yes, also saw it on OCP 4.9.0-fc.1

Can this issue reproduce from the UI?
yes

If this is a regression, please provide more details to justify this:
I don;t think so 

Steps to Reproduce:
1. Install OCP 4.9.0-rc.0 (in this case on top of vSphere 6.7u3 VM HW version 14) 
2. Install/deploy OCS 4.8.1
3. alert (warning) is visible on console and cli (oc adm upgrade) 


Actual results:
Alert is firing when ocs 4.8.1 is deployed on ocp 4.9.0-rc1


Expected results:
OCS 4.8 supported on top of OCP 4.9

Additional info:
attaching screenshot as well
Comment 2 Boris Ranto 2021-09-08 14:36:29 UTC 
What index (ocs-registry) image is this? If this is the ocs-registry:4.8.2-0.cpaas.ci (or latest-4.8 or 4.8.2-901.ci -- they all point to the same image) then this can be expected. That build contains a testing ocs-operator build sent to us by CPaaS devs that have the incorrect OCP versions specified in its Dockerfile (v4.8 only). Please do not use these images, they were created just to gain some confidence into switching to CPaaS in 4.8.3 by running ocs-ci on them. Use the latest-stable-4.8 instead.

I will update the latest-4.8 tag to the proper build to avoid similar confusion in the future.
Comment 3 daniel 2021-09-09 06:17:46 UTC 
@Boris,

I just install 4.9.0-rc.0 and installed OCS from the OperatorHub.
Version according to UI is ocs-operator.v4.8.1

[root@bastion ~]# oc get csv
NAME                  DISPLAY                       VERSION   REPLACES              PHASE
ocs-operator.v4.8.1   OpenShift Container Storage   4.8.1     ocs-operator.v4.8.0   Succeeded
[root@bastion ~]# oc get subscription 
NAME           PACKAGE        SOURCE             CHANNEL
ocs-operator   ocs-operator   redhat-operators   stable-4.8
[root@bastion ~]# 

[root@bastion ~]# oc get csv -o yaml|grep "image: "
                  image: registry.redhat.io/ocs4/ocs-rhel8-operator@sha256:7d734e1e2d11e5fe34516c955c34f322e3a26ee3a53c018b7874191c16b92e18
                  image: registry.redhat.io/ocs4/rook-ceph-rhel8-operator@sha256:44c5029856dffcbb0e49d82ab2c46dd669c8f616e2261e4c98e1a8a9a20de14e
                  image: registry.redhat.io/ocs4/mcg-rhel8-operator@sha256:621443bf5d266f237d57472fd8d561a56fabcd749b6a7e77a2ca300f1053e798
                  image: registry.redhat.io/ocs4/ocs-rhel8-operator@sha256:7d734e1e2d11e5fe34516c955c34f322e3a26ee3a53c018b7874191c16b92e18
    - image: registry.redhat.io/ocs4/rook-ceph-rhel8-operator@sha256:44c5029856dffcbb0e49d82ab2c46dd669c8f616e2261e4c98e1a8a9a20de14e
    - image: registry.redhat.io/ocs4/cephcsi-rhel8@sha256:bdabf43f17c241f77a7597d8ec1a297d6add6607b8ca5e01b844d2447cfd0ceb
    - image: registry.redhat.io/openshift4/ose-csi-node-driver-registrar@sha256:b04cc26a3d18f441444a3e573887103b34ea375c76a6f9f551bd0cb5ea2acfc1
    - image: registry.redhat.io/openshift4/ose-csi-external-resizer-rhel8@sha256:9459e23df133411559bff5165f15ecde4d5d1761ff5e3bba1e879dde4b784689
    - image: registry.redhat.io/openshift4/ose-csi-external-provisioner-rhel8@sha256:6b21014a77465ef5e34e62ee4c7b6cb1209b480bb72856c20e9d0d9af1adaf8a
    - image: registry.redhat.io/openshift4/ose-csi-external-snapshotter-rhel8@sha256:2b3d45bbccf21bbb5a66be8f51af2db9ddd359bebe0798593f7810ae00f60d67
    - image: registry.redhat.io/openshift4/ose-csi-external-attacher@sha256:a718052d08eb63fd2eec200acc64b07b49494ed52fb30306a692b63a42c06226
    - image: registry.redhat.io/rhceph/rhceph-4-rhel8@sha256:0d7d408ccfb1e0f7dd9b846af0724005487b00171b10e4a884d360fdc1dd0ad6
    - image: registry.redhat.io/ocs4/volume-replication-rhel8-operator@sha256:341e7b236a09fa9f3cc48407396e51c5bbf699dbfe954db8525de91453ee56c4
    - image: registry.redhat.io/ocs4/mcg-rhel8-operator@sha256:621443bf5d266f237d57472fd8d561a56fabcd749b6a7e77a2ca300f1053e798
    - image: registry.redhat.io/ocs4/mcg-core-rhel8@sha256:8d3cfe22833be083b76f391febf6c61b2cba24ec5a4758e287feac794003b4f6
    - image: registry.redhat.io/rhel8/postgresql-12@sha256:0c5350728fd5f7739eacaee7f32456d02cf1a2465f9d7fc48bacdcf73dcfa142
    - image: registry.redhat.io/ocs4/ocs-must-gather-rhel8@sha256:ea55e647622d7a82abd06788da4612c86190813610aad2907eb01ca2f5a53919
[root@bastion ~]# 


[root@bastion ~]# oc get -o yaml subs
[...]
  spec:
    channel: stable-4.8
    installPlanApproval: Automatic
    name: ocs-operator
    source: redhat-operators
    sourceNamespace: openshift-marketplace
    startingCSV: ocs-operator.v4.8.1
  status:

[....]
[root@bastion ~]# 

[root@bastion ~]# oc describe packagemanifests ocs-operator  -n openshift-marketplace
Name:         ocs-operator
Namespace:    openshift-marketplace
Labels:       catalog=redhat-operators
              catalog-namespace=openshift-marketplace
              operatorframework.io/arch.amd64=supported
              operatorframework.io/arch.ppc64le=supported
              operatorframework.io/arch.s390x=supported
              operatorframework.io/os.linux=supported
              provider=Red Hat
              provider-url=
Annotations:  <none>
API Version:  packages.operators.coreos.com/v1
Kind:         PackageManifest
Metadata:
  Creation Timestamp:  2021-09-02T15:29:38Z
Spec:
[...]


      Display Name:  OpenShift Container Storage
      Install Modes:
        Supported:  true
        Type:       OwnNamespace
        Supported:  true
        Type:       SingleNamespace
        Supported:  false
        Type:       MultiNamespace
        Supported:  false
        Type:       AllNamespaces
      Keywords:
        storage
        rook
        ceph
        noobaa
        block storage
        shared filesystem
        object storage
      Links:
        Name:  Source Code
        URL:   https://github.com/openshift/ocs-operator
      Maintainers:
        Email:           ocs-support
        Name:            Red Hat Support
      Maturity:          alpha
      Min Kube Version:  1.16.0
      Provider:
        Name:  Red Hat
      Related Images:
        registry.redhat.io/rhel8/postgresql-12@sha256:0c5350728fd5f7739eacaee7f32456d02cf1a2465f9d7fc48bacdcf73dcfa142
        registry.redhat.io/openshift4/ose-csi-external-resizer-rhel8@sha256:9459e23df133411559bff5165f15ecde4d5d1761ff5e3bba1e879dde4b784689
        registry.redhat.io/ocs4/mcg-rhel8-operator@sha256:621443bf5d266f237d57472fd8d561a56fabcd749b6a7e77a2ca300f1053e798
        registry.redhat.io/openshift4/ose-csi-external-attacher@sha256:a718052d08eb63fd2eec200acc64b07b49494ed52fb30306a692b63a42c06226
        registry.redhat.io/ocs4/ocs-must-gather-rhel8@sha256:ea55e647622d7a82abd06788da4612c86190813610aad2907eb01ca2f5a53919
        registry.redhat.io/ocs4/ocs-rhel8-operator@sha256:7d734e1e2d11e5fe34516c955c34f322e3a26ee3a53c018b7874191c16b92e18
        registry.redhat.io/openshift4/ose-csi-external-snapshotter-rhel8@sha256:2b3d45bbccf21bbb5a66be8f51af2db9ddd359bebe0798593f7810ae00f60d67
        registry.redhat.io/rhceph/rhceph-4-rhel8@sha256:0d7d408ccfb1e0f7dd9b846af0724005487b00171b10e4a884d360fdc1dd0ad6
        registry.redhat.io/ocs4/volume-replication-rhel8-operator@sha256:341e7b236a09fa9f3cc48407396e51c5bbf699dbfe954db8525de91453ee56c4
        registry.redhat.io/ocs4/cephcsi-rhel8@sha256:bdabf43f17c241f77a7597d8ec1a297d6add6607b8ca5e01b844d2447cfd0ceb
        registry.redhat.io/ocs4/rook-ceph-rhel8-operator@sha256:44c5029856dffcbb0e49d82ab2c46dd669c8f616e2261e4c98e1a8a9a20de14e
        registry.redhat.io/openshift4/ose-csi-node-driver-registrar@sha256:b04cc26a3d18f441444a3e573887103b34ea375c76a6f9f551bd0cb5ea2acfc1
        registry.redhat.io/openshift4/ose-csi-external-provisioner-rhel8@sha256:6b21014a77465ef5e34e62ee4c7b6cb1209b480bb72856c20e9d0d9af1adaf8a
        registry.redhat.io/ocs4/mcg-core-rhel8@sha256:8d3cfe22833be083b76f391febf6c61b2cba24ec5a4758e287feac794003b4f6
      Version:      4.8.1
    Name:           stable-4.8
  Default Channel:  stable-4.8
  Package Name:     ocs-operator
  Provider:
    Name:  Red Hat
Events:    <none>
#

SO my understanding is, this is the latest official stable release
Comment 5 Boris Ranto 2021-09-14 08:51:06 UTC 
CC'ing @uchapaga ; He had a different idea about this. IIRC, OCP 4.9 dropped compatibility for one of the formats we use in OCS 4.8.1 and it should be fixed in OCS 4.8.2.
Comment 7 N Balachandran 2021-09-22 14:11:52 UTC 
This was fixed in https://bugzilla.redhat.com/show_bug.cgi?id=1995635
Comment 8 Jose A. Rivera 2021-09-22 22:07:58 UTC 
I agree, it looks like this is a duplicate of something that's been resolved. Closing as such.

*** This bug has been marked as a duplicate of bug 1995635 ***