Bug 2167014

Summary: StorageSystem stays in Progressing state due to multiple subscriptions for odf-csi-addons-operator
Product: [Red Hat Storage] Red Hat OpenShift Data Foundation Reporter: Keith Schincke <kschinck>
Component: distributionAssignee: Mudit Agarwal <muagarwa>
Status: CLOSED NOTABUG QA Contact: Petr Balogh <pbalogh>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 4.10CC: ocs-bugs, odf-bz-bot
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-02-07 17:52:35 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
Storage Subscription file none

Description Keith Schincke 2023-02-03 22:24:55 UTC
Created attachment 1942131 [details]
Storage Subscription file

Description of problem:
While installing ODF 4.10, the StorageSystem stays in a progressing mode due to multiple subscriptions for the odf-csi-addons-operator module. 

This feels similar to BZ#2014034

Version-Release number of selected component (if applicable):
OCP 4.10.18 and odf-csi-addons-operator
ODF 4.10


How reproducible:
100% verified with both the listed OCP versions listed


Steps to Reproduce:
1. Install OCP 4.10 (using DCI in this example)
2. Install ODF 4.10 using cli
3. Verify status

Actual results:
The StorageSystem is in a Progressing stage with the following messages:
Warning  ReconcileFailed  54s (x3 over 95s)      StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace]


Expected results:
The StorageSystem not in a progressing stage.

Additional data:
$ oc get clusterversion
NAME      VERSION                              AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.10.0-0.nightly-2023-02-03-103703   True        False         116m    Cluster version is 4.10.0-0.nightly-2023-02-03-103703

$ oc get storagecluster -n openshift-storage ocs-storagecluster -o=jsonpath="{.spec.version}{'\n'}"
4.10.0

$ oc describe  storagesystem -n openshift-storage  ocs-storagecluster-storagesystem | tail -20
    Type:                  VendorCsvReady
    Last Heartbeat Time:   2023-02-03T21:27:30Z
    Last Transition Time:  2023-02-03T21:27:30Z
    Message:               Initializing StorageSystem
    Reason:                Init
    Status:                Unknown
    Type:                  VendorSystemPresent
Events:
  Type     Reason           Age                 From                      Message
  ----     ------           ----                ----                      -------
  Warning  ReconcileFailed  38m (x4 over 38m)   StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace]
  Warning  ReconcileFailed  38m (x4 over 38m)   StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace odf-csi-addons-operator]
  Warning  ReconcileFailed  37m (x3 over 38m)   StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace odf-csi-addons-operator]
  Warning  ReconcileFailed  37m (x4 over 38m)   StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace]
  Warning  ReconcileFailed  34m (x3 over 35m)   StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace odf-csi-addons-operator]
  Warning  ReconcileFailed  30m (x4 over 35m)   StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace]
  Warning  ReconcileFailed  5m19s (x3 over 6m)  StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace odf-csi-addons-operator]
  Warning  ReconcileFailed  4m38s (x4 over 6m)  StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace]
  Warning  ReconcileFailed  31s (x4 over 52s)   StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace odf-csi-addons-operator]
  Warning  ReconcileFailed  10s (x5 over 52s)   StorageSystem controller  multiple Subscriptions found for package 'odf-csi-addons-operator': [odf-csi-addons-operator odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace]

[kni@provisioner cns]$ oc get subscriptions -A
NAMESPACE                 NAME                                                                         PACKAGE                   SOURCE             CHANNEL
openshift-local-storage   local-storage-operator                                                       local-storage-operator    redhat-operators   stable
openshift-storage         mcg-operator-stable-4.10-redhat-operators-openshift-marketplace              mcg-operator              redhat-operators   stable-4.10
openshift-storage         ocs-operator-stable-4.10-redhat-operators-openshift-marketplace              ocs-operator              redhat-operators   stable-4.10
openshift-storage         odf-csi-addons-operator                                                      odf-csi-addons-operator   redhat-operators   stable-4.10
openshift-storage         odf-csi-addons-operator-stable-4.10-redhat-operators-openshift-marketplace   odf-csi-addons-operator   redhat-operators   stable-4.10
openshift-storage         odf-operator                                                                 odf-operator   



Additional info:

Comment 2 Keith Schincke 2023-02-06 21:42:00 UTC
This appears to be a user created issue. 
My odf-operator subscription yaml file had "startingCSV: odf-operator.v10.0" in the spec.
I removed this and was able to get the ocs-storagecluster-storagesystem complete its reconcile and finish 'Progressing'

I am going to review my documentation to see where I got the startingCSV from. 

Keith

Comment 3 Keith Schincke 2023-02-07 17:52:35 UTC
Verified the issue has been resolved with the removal of the startingCSV entry. 

Closing BZ.