Bug 2218015

Summary: [GSS] Unable to add infra toleration for csi-rbdplugin-holder-ocs-storagecluster-cephcluster in rook-ceph-operator-config cm
Product: [Red Hat Storage] Red Hat OpenShift Data Foundation Reporter: Sonal <sarora>
Component: documentationAssignee: Erin Donnelly <edonnell>
Status: ON_QA --- QA Contact: Neha Berry <nberry>
Severity: high Docs Contact:
Priority: unspecified    
Version: 4.12CC: asriram, azaky, brgardne, etamir, kjosy, mrajanna, muagarwa, ocs-bugs, odf-bz-bot, rar, srai
Target Milestone: ---Keywords: Reopened
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: 4.12.12 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-07-25 15:13:52 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Sonal 2023-06-27 20:29:05 UTC
Description of problem (please be detailed as possible and provide log
snippests):

- Trying to add infra toleration in rook-ceph-operator-configmap for csi-rbdplugin-holder-ocs-storagecluster-cephcluster daemon set. Toleration is not reflecting in the ds.

- There are 9 csi-rbdplugin-holder pods running, however desired count is 6 in daemonset. 

Version of all relevant components (if applicable):
ODF 4.12

Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?
Yes, as holder pods are not running on infra node, application pod running on infra node fail to mount pvc with below error:

fetching NodeStageSecretRef openshift-storage/rook-csi-rbd-node failed: kubernetes.io/csi: failed to find the secret rook-csi-rbd-node in the namespace openshift-storage with error: secrets "rook-csi-rbd-node" is forbidden

Is there any workaround available to the best of your knowledge?
No

Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?
3

Can this issue reproducible?
Yes

Can this issue reproduce from the UI?
Yes

If this is a regression, please provide more details to justify this:
No

Steps to Reproduce:
1. Deploy ODF using multus network
2. Add infra taint for infra node in infra machineset
3. Add infra toleration for csi-plugin pods in rook-ceph-operator-configmap

Actual results:
Toleration is missing in csi-cephfsplugin-holder-ocs-storagecluster-cephcluster daemonset.

Expected results:
Toleration should reflect in csi-cephfsplugin-holder-ocs-storagecluster-cephcluster daemonset.

Additional info:
In next private comment.

Comment 12 Blaine Gardner 2023-07-11 15:27:22 UTC
@sarora does Madhu's instruction allow you to proceed? If so, we can close this BZ.

Comment 15 Blaine Gardner 2023-07-25 15:13:52 UTC
Closing since we have insufficient data. Please reopen if needed.

Comment 21 Blaine Gardner 2023-11-10 22:20:13 UTC
@kjosy, you should ask @etamir and @muagarwa about what to do regarding your request above regarding linking to the KCS in 4.13 upgrade docs.