Description of problem: As part of rhcs 5.3 to 6.0 cluster upgrade, we performed rolling re-provision ********************* That is - drain out **all** (mgr, mon, rbd-mirror, node-exporter, osds , etc) daemons in a node to other nodes re-provision node from 8.7 to 9.0 and upgrade to 9.1 Add node back to the cluster Add back daemons other re-provisioned node Repeat on other nodes of the cluster Repeat on peer cluster. ******************** While re-provisioning initial cluster primary cluster, primary cluster daemon nodes have gone unresponsive to images. - All images reported down - newly created primary images reported unknown initially. - secondary image snapshot fetching was too slow/confusing. Version-Release number of selected component (if applicable): 16.2.10-87.el8cp How reproducible: Tried once Steps to Reproduce: MEntioned in description Actual results: Mirroing daemon unresponsive to local images Expected results: Snapshot Mirroring funstionality working as expected Additional info: