Bug 2254936

Summary: RBD Mirror Peer cannot be removed
Product: [Red Hat Storage] Red Hat OpenShift Data Foundation Reporter: Alexander <allee>
Component: odf-drAssignee: Shyamsundar <srangana>
odf-dr sub component: multicluster-orchestrator QA Contact: krishnaram Karthick <kramdoss>
Status: NEW --- Docs Contact:
Severity: unspecified    
Priority: unspecified CC: aclewett, bniver, idryomov, kelwhite, muagarwa, sostapov, srangana
Version: 4.13   
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Comment 14 Alexander 2024-01-25 23:46:57 UTC 
Hello, 

Thanks for giving me more time and describing more about it over chat! 

so in step 10, the instruction is to remove the peer. We have done this however it get's added automatically with a different UUID


here were the steps below taken. Is there something that should be changed at the DR Policy? I also could not find anything to do with helping the troubleshooting for this error in the documentation https://access.redhat.com/documentation/en-us/red_hat_openshift_data_foundation/4.13/html-single/configuring_openshift_data_foundation_disaster_recovery_for_openshift_workloads/index 

sh-5.1$ rbd mirror pool status ocs-storagecluster-cephblockpool


health: ERROR
daemon health: ERROR
image health: OK
images: 0 total
sh-5.1$ rbd mirror pool info ocs-storagecluster-cephblockpool


Mode: image
Site Name: e4d70934-6c49-431a-8a4d-c5494c6be35a

Peer Sites:

UUID: 4ff383e6-2417-44fa-baa4-67767b937853
Name: 23e67d87-fc7b-4a4c-8adb-c71ab26a1960
Mirror UUID: 45c83bbe-7423-4a04-936e-e8289b78802b
Direction: tx-only


UUID: 98c7412f-8399-42ab-9ba3-6ecd0c591a6a
Name: dc18825b-d207-4540-a7b5-e9bfbaca8815
Mirror UUID: 3e91649f-f6f4-45d0-bcd8-8a3a24940852
Direction: rx-tx
Client: client.rbd-mirror-peer
sh-5.1$ rbd mirror pool disable ocs-storagecluster-cephblockpool


2023-12-15T04:55:46.695+0000 7fa71237db80 -1 librbd::api::Mirror: mode_set: mirror peers still registered
sh-5.1$ rbd mirror pool peer remove ocs-storagecluster-cephblockpool 4ff383e6-2417-44fa-baa4-67767b937853
sh-5.1$ rbd mirror pool status ocs-storagecluster-cephblockpool


health: ERROR
daemon health: ERROR
image health: OK
images: 0 total
sh-5.1$ rbd mirror pool info ocs-storagecluster-cephblockpool


Mode: image
Site Name: e4d70934-6c49-431a-8a4d-c5494c6be35a

Peer Sites:

UUID: 98c7412f-8399-42ab-9ba3-6ecd0c591a6a
Name: dc18825b-d207-4540-a7b5-e9bfbaca8815
Mirror UUID: 3e91649f-f6f4-45d0-bcd8-8a3a24940852
Direction: rx-tx
Client: client.rbd-mirror-peer


UUID: 9c42f2b4-919c-4f5b-b60a-218351a0130e
Name: 23e67d87-fc7b-4a4c-8adb-c71ab26a1960
Mirror UUID: 45c83bbe-7423-4a04-936e-e8289b78802b
Direction: tx-only
sh-5.1$ rbd mirror pool enable ocs-storagecluster-cephblockpool pool


note: changing mirroring mode from image to pool
sh-5.1$ rbd mirror pool status ocs-storagecluster-cephblockpool


health: ERROR
daemon health: ERROR
image health: OK
images: 0 total
sh-5.1$ rbd mirror pool info ocs-storagecluster-cephblockpool


Mode: pool
Site Name: e4d70934-6c49-431a-8a4d-c5494c6be35a

Peer Sites:

UUID: 98c7412f-8399-42ab-9ba3-6ecd0c591a6a
Name: dc18825b-d207-4540-a7b5-e9bfbaca8815
Mirror UUID: 3e91649f-f6f4-45d0-bcd8-8a3a24940852
Direction: rx-tx
Client: client.rbd-mirror-peer


UUID: 9c42f2b4-919c-4f5b-b60a-218351a0130e
Name: 23e67d87-fc7b-4a4c-8adb-c71ab26a1960
Mirror UUID: 45c83bbe-7423-4a04-936e-e8289b78802b
Direction: tx-only