Bug 2214278

Summary: [rbd-mirror] : primary- 'demoted ' snapshots piling up after consecutive planned failovers (relocation)
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Vasishta <vashastr>
Component: RBD-MirrorAssignee: Ilya Dryomov <idryomov>
Status: ASSIGNED --- QA Contact:
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 6.1CC: ceph-eng-bugs, cephqe-warriors, idryomov
Target Milestone: ---   
Target Release: 6.1z2   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Vasishta 2023-06-12 13:07:33 UTC 
Description of problem:
snapshots with "state": "demoted" are getting piled up (or not removed) after consecutive planned failover (relocation) operations.

Version-Release number of selected component (if applicable):
17.2.6-70.el9cp

How reproducible:
Tried three time in a cluster, Observed three times

Steps to Reproduce:
1. Configure snapshot based two way mirroring between two clusters
2. Perform planned failover-failback more than two times consecutively and observe mirror snapshots of the images

Actual results:
1374066  .mirror.primary.62ae3f4c-653e-4c07-b413-f1ea026324f4.84fda36e-b16a-40b6-a779-402ac39484e4      100 GiB             Mon Jun 12 03:18:00 2023  mirror (demoted peer_uuids:[])
1379742  .mirror.primary.62ae3f4c-653e-4c07-b413-f1ea026324f4.06fc3331-79e2-4dcf-93e8-625f4a66671c      100 GiB             Mon Jun 12 06:34:55 2023  mirror (demoted peer_uuids:[])
1385799  .mirror.primary.62ae3f4c-653e-4c07-b413-f1ea026324f4.998234c6-63bd-459f-b8dc-cf344ca4c157      100 GiB             Mon Jun 12 09:28:43 2023  mirror (demoted peer_uuids:[])
1388488  .mirror.non_primary.62ae3f4c-653e-4c07-b413-f1ea026324f4.f85b00b8-068e-4751-804b-28615e2106ab  100 GiB             Mon Jun 12 10:38:25 2023  mirror (demoted peer_uuids:[] 68226a72-f0e3-451d-9048-cd35e7d0d0c6:1350197 copied)
1388588  .mirror.primary.62ae3f4c-653e-4c07-b413-f1ea026324f4.309c2860-76a6-4277-a8e3-4792c87069f6      100 GiB             Mon Jun 12 10:39:10 2023  mirror (primary peer_uuids:[])
1388612  .mirror.primary.62ae3f4c-653e-4c07-b413-f1ea026324f4.390655c4-c139-461a-9224-7897902802cd      100 GiB             Mon Jun 12 10:40:01 2023  mirror (primary peer_uuids:[68a6c766-37ed-4d54-97c3-67556467bb89])

Expected results:
Preserve snapshots which are required for the mirroring functionality