Bug 2002933

Summary: Two storage systems getting created with external mode RHCS
Product: OpenShift Container Platform Reporter: OpenShift BugZilla Robot <openshift-bugzilla-robot>
Component: Console Storage PluginAssignee: Afreen <afrahman>
Status: CLOSED ERRATA QA Contact: Jilju Joy <jijoy>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 4.9CC: aos-bugs, ebenahar, jijoy, nberry, nthomas, ocs-bugs
Target Milestone: ---   
Target Release: 4.9.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-11-01 13:44:33 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 2002763    
Bug Blocks:    

Comment 1 Jilju Joy 2021-09-17 11:04:38 UTC
Adding my observations from the recent deployment on external mode(Ceph).


Initially two storage system and two storage clusters got created. The phase of the storage cluster "ocs-external-storagecluster" was ignored.

$ oc get storagesystem
NAME                                        STORAGE-SYSTEM-KIND                  STORAGE-SYSTEM-NAME
ocs-external-storagecluster-storagesystem   storagecluster.ocs.openshift.io/v1   ocs-external-storagecluster
ocs-storagecluster-storagesystem            storagecluster.ocs.openshift.io/v1   ocs-storagecluster


$  oc get storagecluster
NAME                          AGE     PHASE     EXTERNAL   CREATED AT             VERSION
ocs-external-storagecluster   5m47s   Ignored   true       2021-09-16T11:35:23Z   4.9.0
ocs-storagecluster            5m47s   Error                2021-09-16T11:35:23Z   


Deleted ocs-storagecluster and ocs-storagecluster-storagesystem.
The storage cluster "ocs-external-storagecluster" is still remaining in Ignored phase.

$ oc get storagecluster
NAME                          AGE   PHASE     EXTERNAL   CREATED AT             VERSION
ocs-external-storagecluster   23h   Ignored   true       2021-09-16T11:35:23Z   4.9.0

$ oc get storagecluster -o yaml
apiVersion: v1
items:
- apiVersion: ocs.openshift.io/v1
  kind: StorageCluster
  metadata:
    annotations:
      storagesystem.odf.openshift.io/watched-by: ocs-external-storagecluster-storagesystem
      uninstall.ocs.openshift.io/cleanup-policy: delete
      uninstall.ocs.openshift.io/mode: graceful
    creationTimestamp: "2021-09-16T11:35:23Z"
    finalizers:
    - storagecluster.ocs.openshift.io
    generation: 3
    name: ocs-external-storagecluster
    namespace: openshift-storage
    resourceVersion: "36460"
    uid: 5761eee7-145e-40a0-b642-9afc4044b0ec
  spec:
    arbiter: {}
    encryption:
      kms: {}
    externalStorage:
      enable: true
    labelSelector: {}
    managedResources:
      cephBlockPools: {}
      cephConfig: {}
      cephDashboard: {}
      cephFilesystems: {}
      cephObjectStoreUsers: {}
      cephObjectStores: {}
    version: 4.9.0
  status:
    images:
      ceph:
        desiredImage: quay.io/rhceph-dev/rhceph@sha256:efe1391ab28c3363308093a55f088a62eda06eab49bed707164c8db0d7dcb7dd
      noobaaCore:
        desiredImage: quay.io/rhceph-dev/mcg-core@sha256:c8a5090910e096b480d2f7e59bd277effa17c4a5c128743d71af7c606de73c5b
      noobaaDB:
        desiredImage: registry.redhat.io/rhel8/postgresql-12@sha256:0c5350728fd5f7739eacaee7f32456d02cf1a2465f9d7fc48bacdcf73dcfa142
    phase: Ignored
kind: List
metadata:
  resourceVersion: ""
  selfLink: ""


$ oc get storagesystem
NAME                                        STORAGE-SYSTEM-KIND                  STORAGE-SYSTEM-NAME
ocs-external-storagecluster-storagesystem   storagecluster.ocs.openshift.io/v1   ocs-external-storagecluster




Storagesystem conditiona from yaml:

spec:
    kind: storagecluster.ocs.openshift.io/v1
    name: ocs-external-storagecluster
    namespace: openshift-storage
  status:
    conditions:
    - lastHeartbeatTime: "2021-09-16T11:35:24Z"
      lastTransitionTime: "2021-09-16T11:35:24Z"
      message: Reconcile is completed successfully
      reason: ReconcileCompleted
      status: "True"
      type: Available
    - lastHeartbeatTime: "2021-09-16T11:35:24Z"
      lastTransitionTime: "2021-09-16T11:35:24Z"
      message: Reconcile is completed successfully
      reason: ReconcileCompleted
      status: "False"
      type: Progressing
    - lastHeartbeatTime: "2021-09-16T11:35:23Z"
      lastTransitionTime: "2021-09-16T11:35:23Z"
      message: StorageSystem CR is valid
      reason: Valid
      status: "False"
      type: StorageSystemInvalid
    - lastHeartbeatTime: "2021-09-16T11:35:24Z"
      lastTransitionTime: "2021-09-16T11:35:24Z"
      reason: Ready
      status: "True"
      type: VendorCsvReady
    - lastHeartbeatTime: "2021-09-16T11:35:24Z"
      lastTransitionTime: "2021-09-16T11:35:24Z"
      reason: Found
      status: "True"
      type: VendorSystemPresent



$ oc get cephcluster 
NAME                                      DATADIRHOSTPATH   MONCOUNT   AGE   PHASE       MESSAGE                          HEALTH      EXTERNAL
ocs-external-storagecluster-cephcluster                                23h   Connected   Cluster connected successfully   HEALTH_OK   true


$ oc exec rook-ceph-tools-external-5c68b9685c-6bdn7 -- ceph status
  cluster:
    id:     24f85a95-9745-45bb-b987-d53a0705ee41
    health: HEALTH_OK
 
  services:
    mon: 3 daemons, quorum dell-r730-015,dell-r730-019,dell-r730-026 (age 4w)
    mgr: dell-r730-019(active, since 4w), standbys: dell-r730-026, dell-r730-015
    mds: cephfs:1 {0=dell-r640-003=up:active} 1 up:standby
    osd: 5 osds: 5 up (since 4w), 5 in (since 5w)
    rgw: 2 daemons active (dell-r730-019.rgw0, dell-r730-026.rgw0)
 
  task status:
    scrub status:
        mds.dell-r640-003: idle
 
  data:
    pools:   9 pools, 264 pgs
    objects: 22.58k objects, 82 GiB
    usage:   249 GiB used, 11 TiB / 11 TiB avail
    pgs:     264 active+clean
 
  io:
    client:   1.8 KiB/s rd, 27 KiB/s wr, 1 op/s rd, 4 op/s wr

Comment 7 errata-xmlrpc 2021-11-01 13:44:33 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.9.5 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:4005