Bug 2102061

Summary:	[rbd] : rbd mirror mirror snapshot creation stuck at - CreateSnapshotRequests.add : previous request is still in progress
Product:	[Red Hat Storage] Red Hat Ceph Storage	Reporter:	Vasishta <vashastr>
Component:	RBD	Assignee:	Prasanna Kumar Kalever <prasanna.kalever>
Status:	NEW ---	QA Contact:	Manasa <mgowri>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	5.1	CC:	acaro, ceph-eng-bugs, cephqe-warriors, idryomov, mmurthy, sostapov
Target Milestone:	---
Target Release:	9.1
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:		Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Vasishta 2022-06-29 08:56:14 UTC

Description of problem:
When mirror snapshot schedule is set, snapshot creation is stuck behind and mgr log says - 
CreateSnapshotRequests.add: 3//<image-id>: previous request is still in progress

Version-Release number of selected component (if applicable):
16.2.7-126.el8cp

How reproducible:
Twice

Steps to Reproduce:
1. Configure 2 clusters
2. Run I/Os on image for days
3. Monitor snapshot ls --all on all images

Actual results:
snapshot creation stuck for some images behind indefinitely 

Expected results:
Snapshot should get created based on the request from scheduler

Additional info:
This issue was found while working on BZ 2099799
Basic analysis can be found in https://bugzilla.redhat.com/show_bug.cgi?id=2099799#c8

Comment 6 Scott Ostapovicz 2023-02-06 16:57:22 UTC

 Missed the 5.3 z1 window.  Moving to 6.1.  Please advise if this is a problem.