Bug 2259667

Summary:	[4.14.z]Static name for cephfs and RBD CSI driver deployed by ocs-client-operator
Product:	[Red Hat Storage] Red Hat OpenShift Data Foundation	Reporter:	Madhu Rajanna <mrajanna>
Component:	ocs-client-operator	Assignee:	Madhu Rajanna <mrajanna>
Status:	CLOSED COMPLETED	QA Contact:	Neha Berry <nberry>
Severity:	unspecified	Docs Contact:
Priority:	unspecified
Version:	4.14	CC:	ebenahar, kramdoss, lgangava, muagarwa, nberry, odf-bz-bot, omitrani, sheggodu
Target Milestone:	---
Target Release:	ODF 4.14.5
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	4.14.5-2	Doc Type:	No Doc Update
Doc Text:		Story Points:	---
Clone Of:	2259664	Environment:
Last Closed:	2024-07-22 10:55:15 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	2259664
Bug Blocks:

Description Madhu Rajanna 2024-01-22 15:47:09 UTC

+++ This bug was initially created as a clone of Bug #2259664 +++

As of today if a cephcsi driver is deployed by ocs-client-operator in any namespace (example openshift-client) it gets a name that contains the prefix as the namespace name and it will be named as openshift-client.rbd.csi.ceph.com and openshift-client-cephfs.csi.ceph.com but this is not static and can cause the problem in choosing the right storage profile for CNV as CNV always expects static driver names irrespective of the namespace where the client is deployed.

This BZ is to make the csi driver name consistent irrespective of the namespace where it is deployed and the driver name should be openshift-storage.rbd.csi.ceph.com and openshift-storage.cephfs.csi.ceph.com

--- Additional comment from RHEL Program Management on 2024-01-22 15:27:36 UTC ---

This bug having no release flag set previously, is now set with release flag 'odf‑4.15.0' to '?', and so is being proposed to be fixed at the ODF 4.15.0 release. Note that the 3 Acks (pm_ack, devel_ack, qa_ack), if any previously set while release flag was missing, have now been reset since the Acks are to be set against a release flag.

Comment 4 Neha Berry 2024-01-31 08:00:04 UTC

Verified the fix on multiple versions and working as expected. 

1.  ODF 4.15.0-126 and OCP version 4.15.0-0.nightly-2024-01-25-051548 on a provider/client HCP cluster, 
2. on ODF 4.14.5-2 (where the fix is back ported in custom fusion build) 
3. and rechecked on 4.14.4-5 (where the fix is not present)





Native ODF client on provider with ODF 4.15 and native ODF client 4.14.5-2
===============================


oc get Storageclasses
NAME                                    PROVISIONER                             RECLAIMPOLICY   VOLUMEBINDINGMODE      ALLOWVOLUMEEXPANSION   AGE
lso-storageclass                        kubernetes.io/no-provisioner            Delete          WaitForFirstConsumer   false                  38h
ocs-storagecluster-ceph-rbd (default)   openshift-storage.rbd.csi.ceph.com      Delete          Immediate              true                   24h
ocs-storagecluster-ceph-rgw             openshift-storage.ceph.rook.io/bucket   Delete          Immediate              false                  37h
ocs-storagecluster-cephfs               openshift-storage.cephfs.csi.ceph.com   Delete          Immediate              true                   24h
openshift-storage.noobaa.io             openshift-storage.noobaa.io/obc         Delete          Immediate              false                  24h
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get Storageclassclaim
NAME                          STORAGETYPE        STORAGEPROFILE   STORAGECLIENTNAME   STORAGECLIENTNAMESPACE     PHASE
ocs-storagecluster-ceph-rbd   blockpool                           storage-client      openshift-storage-client   Ready
ocs-storagecluster-cephfs     sharedfilesystem                    storage-client      openshift-storage-client   Ready


[jenkins@temp-jagent-hcp414-aaa ~]$ oc get volumesnapshotclass
NAME                          DRIVER                                  DELETIONPOLICY   AGE
ocs-storagecluster-ceph-rbd   openshift-storage.rbd.csi.ceph.com      Delete           24h
ocs-storagecluster-cephfs     openshift-storage.cephfs.csi.ceph.com   Delete           24h
[jenkins@temp-jagent-hcp414-aaa ~]$ 



oc get csv -n openshift-storage-client
NAME                                           DISPLAY                            VERSION               REPLACES                                PHASE
metallb-operator.v4.14.0-202401151553          MetalLB Operator                   4.14.0-202401151553                                           Succeeded
ocs-client-operator.v4.14.5-2.fusion-hci       OpenShift Data Foundation Client   4.14.5-2.fusion-hci   ocs-client-operator.v4.14.4-rhodf       Succeeded
odf-csi-addons-operator.v4.14.5-2.fusion-hci   CSI Addons                         4.14.5-2.fusion-hci   odf-csi-addons-operator.v4.14.4-rhodf   Succeeded






>> With HCP client 4.15

export KUBECONFIG=/home/jenkins/ibm_kube/kubeconfig_hcp414-bb.yaml 
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get csv -n openshift-storage-client
NAME                                         DISPLAY                            VERSION             REPLACES   PHASE
ocs-client-operator.v4.15.0-126.stable       OpenShift Data Foundation Client   4.15.0-126.stable              Succeeded
odf-csi-addons-operator.v4.15.0-126.stable   CSI Addons                         4.15.0-126.stable              Succeeded
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get clusterversion -o yaml|grep -i clusterID
    clusterID: a696155d-fc47-49a1-8cee-a4462cc21e88
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get volumesnapshotclass
NAME                          DRIVER                                  DELETIONPOLICY   AGE
ocs-storagecluster-ceph-rbd   openshift-storage.rbd.csi.ceph.com      Delete           13h
ocs-storagecluster-cephfs     openshift-storage.cephfs.csi.ceph.com   Delete           13h
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get csidriver -A
NAME                                    ATTACHREQUIRED   PODINFOONMOUNT   STORAGECAPACITY   TOKENREQUESTS   REQUIRESREPUBLISH   MODES        AGE
csi.kubevirt.io                         true             true             false             <unset>         false               Persistent   14h
openshift-storage.cephfs.csi.ceph.com   true             false            false             <unset>         false               Persistent   13h
openshift-storage.rbd.csi.ceph.com      true             false            false             <unset>         false               Persistent   13h
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get storageclassclaim
NAME                          STORAGETYPE        STORAGEPROFILE   STORAGECLIENTNAME   STORAGECLIENTNAMESPACE     PHASE
ocs-storagecluster-ceph-rbd   blockpool                           storage-client      openshift-storage-client   Ready
ocs-storagecluster-cephfs     sharedfilesystem                    storage-client      openshift-storage-client   Ready
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get storageclass
NAME                                   PROVISIONER                             RECLAIMPOLICY   VOLUMEBINDINGMODE   ALLOWVOLUMEEXPANSION   AGE
kubevirt-csi-infra-default (default)   csi.kubevirt.io                         Delete          Immediate           false                  14h
ocs-storagecluster-ceph-rbd            openshift-storage.rbd.csi.ceph.com      Delete          Immediate           true                   13h
ocs-storagecluster-cephfs              openshift-storage.cephfs.csi.ceph.com   Delete          Immediate           true                   13h
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get route -n openshift-console
NAME        HOST/PORT                                                                       PATH   SERVICES    PORT    TERMINATION          WILDCARD
console     console-openshift-console.apps.hcp414-bb.apps.ibm-cloud-pv-cl.qe.rh-ocs.com            console     https   reencrypt/Redirect   None
downloads   downloads-openshift-console.apps.hcp414-bb.apps.ibm-cloud-pv-cl.qe.rh-ocs.com          downloads   http    edge/Redirect        None
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get 



Able to create PVCs, PODs and volumesnapshots

oc get pvc
NAME                       STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                  AGE
pvc-cephfs-rwo-izrwcxhlx   Bound    pvc-1fb623b0-9816-45eb-8429-c051b4007674   5Gi        RWO            ocs-storagecluster-cephfs     21m
pvc-cephfs-rwo-rhmttnsbg   Bound    pvc-a6aeb7af-d409-436b-bd00-7105200fac6b   5Gi        RWO            ocs-storagecluster-cephfs     21m
pvc-cephfs-rwo-uretxhjnp   Bound    pvc-d6dad453-f2e7-40dd-806c-4b39c474766d   5Gi        RWO            ocs-storagecluster-cephfs     21m
pvc-cephfs-rwx-ajsdmzkin   Bound    pvc-ed002ea6-ae74-4d10-a521-0314ad433e83   5Gi        RWX            ocs-storagecluster-cephfs     23m
pvc-cephfs-rwx-fbrnarusr   Bound    pvc-11811127-1a55-49ee-b275-0a733e314b1f   5Gi        RWX            ocs-storagecluster-cephfs     23m
pvc-cephfs-rwx-grliobxod   Bound    pvc-d365f640-101d-4e29-b61b-c093417f1339   5Gi        RWX            ocs-storagecluster-cephfs     23m
pvc-cephfs-rwx-lhkuwdvfh   Bound    pvc-2dca74d0-029f-4f51-ae04-1b6e7a9e3641   5Gi        RWX            ocs-storagecluster-cephfs     22m
pvc-rbd-rwo-axvfyeblu      Bound    pvc-cd6a57ce-d72c-4337-927e-69e8cedc1d5a   5Gi        RWO            ocs-storagecluster-ceph-rbd   21m
pvc-rbd-rwo-bzlllymnv      Bound    pvc-eb6f0b10-920f-44a6-8070-816fa9056d3d   5Gi        RWO            ocs-storagecluster-ceph-rbd   21m
pvc-rbd-rwx-anpqgzvjz      Bound    pvc-59c9209e-dfd6-402a-80f6-adca9b3d2198   5Gi        RWX            ocs-storagecluster-ceph-rbd   22m
pvc-rbd-rwx-kjrpcjbme      Bound    pvc-18bd0509-f151-49d5-89ce-cd2dce4683e8   5Gi        RWX            ocs-storagecluster-ceph-rbd   22m
pvc-rbd-rwx-lldqhpupn      Bound    pvc-1e836fc3-2cf9-4dcc-822f-f0c8f0045f3c   5Gi        RWX            ocs-storagecluster-ceph-rbd   22m
pvc-rbd-rwx-sookcarua      Bound    pvc-04667be7-cc01-4235-96c2-ac1e82a15ed6   5Gi        RWX            ocs-storagecluster-ceph-rbd   22m
[jenkins@temp-jagent-hcp414-aaa Deploymentconfig]$ oc get volumesnapshot
No resources found in io-pods2 namespace.
[jenkins@temp-jagent-hcp414-aaa Deploymentconfig]$ oc get volumesnapshot -A
NAMESPACE                  NAME                READYTOUSE   SOURCEPVC   SOURCESNAPSHOTCONTENT   RESTORESIZE   SNAPSHOTCLASS                 SNAPSHOTCONTENT                                    CREATIONTIME   AGE
openshift-storage-client   rbd-bb-1-snapshot   true         rbd-bb-1                            40Gi          ocs-storagecluster-ceph-rbd   snapcontent-e2aa1d8f-a428-4ccd-9f45-ae3d6b18d87b   90m            90m
[jenkins@temp-jagent-hcp414-aaa Deploymentconfig]$ oc get pods


[jenkins@temp-jagent-hcp414-aaa Deploymentconfig]$ oc get pods -o wide
NAME                                  READY   STATUS      RESTARTS   AGE   IP            NODE                       NOMINATED NODE   READINESS GATES
fedorapod-cephfs-rwo-baxrv-1-deploy   0/1     Completed   0          21m   10.133.0.18   hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-cephfs-rwo-baxrv-1-z9hw2    1/1     Running     0          21m   10.132.0.47   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-cephfs-rwo-miqqp-1-9j444    1/1     Running     0          21m   10.132.0.49   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-cephfs-rwo-miqqp-1-deploy   0/1     Completed   0          21m   10.132.0.48   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-cephfs-rwo-snokk-1-deploy   0/1     Completed   0          21m   10.132.0.46   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-cephfs-rwo-snokk-1-k59l7    1/1     Running     0          21m   10.133.0.19   hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-cephfs-rwx-dpfay-1-74jdv    1/1     Running     0          23m   10.132.0.30   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-cephfs-rwx-dpfay-1-deploy   0/1     Completed   0          23m   10.132.0.29   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-cephfs-rwx-kpusb-1-ct557    1/1     Running     0          23m   10.133.0.5    hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-cephfs-rwx-kpusb-1-deploy   0/1     Completed   0          23m   10.132.0.25   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-cephfs-rwx-mdeok-1-deploy   0/1     Completed   0          23m   10.133.0.6    hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-cephfs-rwx-mdeok-1-wkqgm    1/1     Running     0          23m   10.133.0.11   hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-cephfs-rwx-yezro-1-deploy   0/1     Completed   0          23m   10.132.0.31   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-cephfs-rwx-yezro-1-ssnt9    1/1     Running     0          23m   10.132.0.32   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-rbd-rwo-kutya-1-9pxkh       1/1     Running     0          21m   10.133.0.22   hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-rbd-rwo-kutya-1-deploy      0/1     Completed   0          21m   10.133.0.21   hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-rbd-rwo-oqzhq-1-8c9mx       1/1     Running     0          21m   10.132.0.51   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-rbd-rwo-oqzhq-1-deploy      0/1     Completed   0          21m   10.132.0.50   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-rbd-rwx-ggvlp-1-597nc       1/1     Running     0          22m   10.133.0.17   hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-rbd-rwx-ggvlp-1-deploy      0/1     Completed   0          22m   10.133.0.13   hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-rbd-rwx-khluy-1-8nv68       1/1     Running     0          22m   10.132.0.37   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-rbd-rwx-khluy-1-deploy      0/1     Completed   0          22m   10.132.0.36   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-rbd-rwx-uqioa-1-deploy      0/1     Completed   0          22m   10.132.0.38   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-rbd-rwx-uqioa-1-lkc56       1/1     Running     0          22m   10.132.0.45   hcp414-bb-926e8fcb-gq9pj   <none>           <none>
fedorapod-rbd-rwx-yurxl-1-9wpnj       1/1     Running     0          22m   10.133.0.12   hcp414-bb-926e8fcb-697cg   <none>           <none>
fedorapod-rbd-rwx-yurxl-1-deploy      0/1     Completed   0          22m   10.132.0.34   hcp414-bb-926e8fcb-gq9pj   <none>           <none>



sh-5.0# dd if=/dev/zero of=/mnt/date.dat bs=100M count=5
5+0 records in
5+0 records out
524288000 bytes (524 MB, 500 MiB) copied, 5.60773 s, 93.5 MB/s
sh-5.0# ls -ltrh
total 500M
-rw-r--r--. 1 root 2000 500M Jan 31 07:50 date.dat
sh-5.0# df -kh|grep mnt
169.61.253.178:6789,169.61.253.181:6789,169.61.253.185:6789:/volumes/cephfilesystemsubvolumegroup-storageconsumer-a696155d-fc47-49a1-8cee-a4462cc21e88-bfc15763/csi-vol-b9ba1896-0b86-43c8-9d4c-21a9eef45ccf/797ccf20-7e6b-4abd-b309-1e226718a537  5.0G  500M  4.6G  10% /mnt


ODF client on HCP hcp414-aa (where the client version is 4.14.4-5(without fix)
==================

[jenkins@temp-jagent-hcp414-aaa ~]$ oc get csv -n openshift-storage-client
NAME                                           DISPLAY                            VERSION               REPLACES                                PHASE
ocs-client-operator.v4.14.4-5.fusion-hci       OpenShift Data Foundation Client   4.14.4-5.fusion-hci   ocs-client-operator.v4.14.3-rhodf       Succeeded
odf-csi-addons-operator.v4.14.4-5.fusion-hci   CSI Addons                         4.14.4-5.fusion-hci   odf-csi-addons-operator.v4.14.3-rhodf   Succeeded


oc get nodes
NAME                       STATUS   ROLES    AGE   VERSION
hcp414-aa-9b939b9d-89b85   Ready    worker   16h   v1.27.9+5c56cc3
hcp414-aa-9b939b9d-p9bjd   Ready    worker   16h   v1.27.9+5c56cc3
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get csidriver
NAME                                           ATTACHREQUIRED   PODINFOONMOUNT   STORAGECAPACITY   TOKENREQUESTS   REQUIRESREPUBLISH   MODES        AGE
csi.kubevirt.io                                true             true             false             <unset>         false               Persistent   16h
openshift-storage-client.cephfs.csi.ceph.com   true             false            false             <unset>         false               Persistent   15h
openshift-storage-client.rbd.csi.ceph.com      true             false            false             <unset>         false               Persistent   15h
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get volumesnapshotclass
\NAME                          DRIVER                                         DELETIONPOLICY   AGE
ocs-storagecluster-ceph-rbd   openshift-storage-client.rbd.csi.ceph.com      Delete           15h
ocs-storagecluster-cephfs     openshift-storage-client.cephfs.csi.ceph.com   Delete           15h
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get Storageclassclaim
NAME                          STORAGETYPE        STORAGEPROFILE   STORAGECLIENTNAME   STORAGECLIENTNAMESPACE     PHASE
ocs-storagecluster-ceph-rbd   blockpool                           storage-client      openshift-storage-client   Ready
ocs-storagecluster-cephfs     sharedfilesystem                    storage-client      openshift-storage-client   Ready
[jenkins@temp-jagent-hcp414-aaa ~]$ oc get Storageclasses
NAME                                   PROVISIONER                                    RECLAIMPOLICY   VOLUMEBINDINGMODE   ALLOWVOLUMEEXPANSION   AGE
kubevirt-csi-infra-default (default)   csi.kubevirt.io                                Delete          Immediate           false                  16h
ocs-storagecluster-ceph-rbd            openshift-storage-client.rbd.csi.ceph.com      Delete          Immediate           true                   15h
ocs-storagecluster-cephfs              openshift-storage-client.cephfs.csi.ceph.com   Delete          Immediate           true                   15h