Description of problem (please be detailed as possible and provide log
snippets):

[RDR] ceph-mgr IP is getting blocklisted in ceph


Version of all relevant components (if applicable):


    "mon": {
        "ceph version 16.2.10-72.el8cp (3311949c2d1edf5cabcc20ba0f35b4bfccbf021e) pacific (stable)": 3
    },
    "mgr": {
        "ceph version 16.2.10-72.el8cp (3311949c2d1edf5cabcc20ba0f35b4bfccbf021e) pacific (stable)": 1
    },
    "osd": {
        "ceph version 16.2.10-72.el8cp (3311949c2d1edf5cabcc20ba0f35b4bfccbf021e) pacific (stable)": 6
    },
    "mds": {
        "ceph version 16.2.10-72.el8cp (3311949c2d1edf5cabcc20ba0f35b4bfccbf021e) pacific (stable)": 2
    },
    "rbd-mirror": {
        "ceph version 16.2.10-72.el8cp (3311949c2d1edf5cabcc20ba0f35b4bfccbf021e) pacific (stable)": 1
    },
    "rgw": {
        "ceph version 16.2.10-72.el8cp (3311949c2d1edf5cabcc20ba0f35b4bfccbf021e) pacific (stable)": 1
    },
    "overall": {
        "ceph version 16.2.10-72.el8cp (3311949c2d1edf5cabcc20ba0f35b4bfccbf021e) pacific (stable)": 14
    }
}


Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?


Is there any workaround available to the best of your knowledge?


Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?


Can this issue reproducible?


Can this issue reproduce from the UI?


If this is a regression, please provide more details to justify this:


Steps to Reproduce:
1.
2.
3.


Actual results:

sh-4.4$ ceph osd blocklist ls
10.129.2.24:0/4139543229 2022-11-20T13:49:24.365265+0000
listed 1 entries


[amagrawa@amagrawa ~]$ oc get pods -o wide -n openshift-storage
rook-ceph-mgr-a-5d5ff57db6-h54j7                                  2/2   
Running     1 (28h ago)   4d2h    10.129.2.24    compute-2   <none>         
<none>



Expected results:



Additional info:

Logs from all the clusters could be found here-
http://rhsqe-repo.lab.eng.blr.redhat.com/OCS/ocs-qe-bugs/bz-aman/20nov22/