Back to bug 2067095

Who When What Removed Added
Karolin Seeger 2022-03-23 10:37:56 UTC CC kseeger
Shyamsundar 2022-03-23 11:24:58 UTC CC srangana
Scott Ostapovicz 2022-03-23 13:47:37 UTC Assignee sostapov idryomov
krishnaram Karthick 2022-03-24 14:50:23 UTC QA Contact nberry prsurve
CC kramdoss
Matthias Muench 2022-03-25 08:21:39 UTC CC mmuench
Karolin Seeger 2022-03-25 09:11:15 UTC Summary [DR] rbd mirror sheduling is getting stopped for some images [DR] rbd mirror scheduling is getting stopped for some images
Mudit Agarwal 2022-03-28 13:24:11 UTC Status NEW ASSIGNED
Scott Ostapovicz 2022-03-29 14:35:22 UTC Blocks 2069720
Scott Ostapovicz 2022-03-29 14:41:36 UTC Summary [DR] rbd mirror scheduling is getting stopped for some images [DR] [tracker for BZ 2069720] rbd mirror scheduling is getting stopped for some images
CC sostapov
Scott Ostapovicz 2022-03-29 14:47:58 UTC Keywords TestBlocker, Tracking
Josh Durgin 2022-03-29 15:26:13 UTC Assignee idryomov choffman
CC jdurgin
Ilya Dryomov 2022-03-29 16:50:07 UTC CC idryomov
Flags needinfo?(prsurve)
Pratik Surve 2022-03-30 03:49:02 UTC Flags needinfo?(prsurve)
Orit Wasserman 2022-04-07 11:03:03 UTC CC owasserm
James Espy 2022-04-19 15:23:13 UTC CC jespy
Sidhant Agrawal 2022-04-20 20:04:18 UTC CC sagrawal
Aman Agrawal 2022-06-02 13:28:15 UTC CC amagrawa
Ilya Dryomov 2022-06-02 15:45:21 UTC Flags needinfo?(amagrawa)
Aman Agrawal 2022-06-02 18:34:24 UTC Flags needinfo?(amagrawa)
Aman Agrawal 2022-06-02 18:38:57 UTC Flags needinfo?(idryomov)
Christopher Hoffman 2022-06-13 22:18:00 UTC Flags needinfo?(srangana)
Ilya Dryomov 2022-06-15 12:15:53 UTC Flags needinfo?(idryomov)
Ilya Dryomov 2022-06-21 17:50:08 UTC Blocks 2099799
Ilya Dryomov 2022-06-22 06:55:57 UTC Assignee choffman idryomov
Ilya Dryomov 2022-06-22 06:56:27 UTC Flags needinfo?(srangana)
Mudit Agarwal 2022-06-29 13:37:22 UTC Blocks 2102221
Mudit Agarwal 2022-06-29 13:38:49 UTC Blocks 2102221
Mudit Agarwal 2022-06-29 13:45:29 UTC Fixed In Version 4.11.0-107
Depends On 2069720
Blocks 2069720, 2099799
Mudit Agarwal 2022-06-29 13:46:49 UTC Status ASSIGNED ON_QA
krishnaram Karthick 2022-06-30 05:58:44 UTC Sub Component RBD-Mirror
CC vashastr
QA Contact prsurve ebenahar
RHEL Program Management 2022-06-30 05:58:51 UTC Target Release --- ODF 4.11.0
Red Hat Bugzilla 2022-07-01 09:20:06 UTC Doc Type If docs needed, set a value No Doc Update
Elad 2022-07-19 14:49:54 UTC QA Contact ebenahar kramdoss
krishnaram Karthick 2022-07-20 12:30:09 UTC QA Contact kramdoss prsurve
krishnaram Karthick 2022-07-22 16:13:50 UTC Summary [DR] [tracker for BZ 2069720] rbd mirror scheduling is getting stopped for some images [RDR] [tracker for BZ 2069720] rbd mirror scheduling is getting stopped for some images
krishnaram Karthick 2022-07-26 09:36:09 UTC Status ON_QA ASSIGNED
Ilya Dryomov 2022-07-27 07:30:44 UTC Depends On 2111364
Ilya Dryomov 2022-07-27 07:54:57 UTC Depends On 2111375
Shyamsundar 2022-07-28 14:17:10 UTC CC uchapaga
Flags needinfo?(uchapaga)
umanga 2022-08-02 06:26:04 UTC Flags needinfo?(uchapaga)
Ilya Dryomov 2022-08-09 12:03:01 UTC Flags needinfo?(prsurve)
Ilya Dryomov 2022-08-09 13:58:05 UTC Depends On 2116900
Mudit Agarwal 2022-08-09 14:00:23 UTC Depends On 2116900
Pratik Surve 2022-08-10 10:13:18 UTC Flags needinfo?(prsurve)
Aman Agrawal 2022-08-10 13:46:29 UTC Blocks 2094357
Mudit Agarwal 2022-08-11 05:03:00 UTC Flags needinfo?(idryomov)
Doc Type No Doc Update Known Issue
Ilya Dryomov 2022-08-11 11:16:44 UTC Flags needinfo?(idryomov)
Federico Lucifredi 2022-08-11 23:40:23 UTC CC flucifre
Shyamsundar 2022-08-17 12:59:20 UTC Flags needinfo?(uchapaga)
Aman Agrawal 2022-08-18 14:40:27 UTC Flags needinfo?(idryomov)
Ilya Dryomov 2022-08-18 19:18:51 UTC Flags needinfo?(idryomov) needinfo?(amagrawa)
Aman Agrawal 2022-08-19 10:40:09 UTC Flags needinfo?(amagrawa)
Shyamsundar 2022-08-22 14:22:36 UTC CC olakra
Flags needinfo?(idryomov) needinfo?(amagrawa) needinfo?(olakra)
Aman Agrawal 2022-08-22 16:01:33 UTC Flags needinfo?(amagrawa)
Olive Lakra 2022-08-23 07:28:17 UTC Doc Text .RBD mirror scheduling is getting stopped for some images

The Ceph manager daemon gets blocklisted due to different reasons, which causes the scheduled RBD mirror snapshot from being triggered on the cluster where the image(s) are primary. All RBD images that are mirror enabled (hence DR protected) do not list a schedule when examined using `rbd mirror snapshot schedule status -p ocs-storagecluster-cephblockpool`, and hence are not actively mirrored to the peer site.

Workaround: Restart the Ceph manager deployment, on the managed cluster where the images are primary, to overcome the blocklist against the currently running instance, this can be done by scaling down and then later scaling up the ceph manager deployment as follows:

$ oc -n openshift-storage scale deployments/rook-ceph-mgr-a --replicas=0

Result: Images that are DR enabled and denoted as primary on a managed cluster start reporting mirroring schedules when examined using `rbd mirror snapshot schedule status -p ocs-storagecluster-cephblockpool`
RHEL Program Management 2022-08-23 08:33:02 UTC Target Release ODF 4.11.0 --- --- ODF 4.12.0
Ilya Dryomov 2022-08-23 08:45:19 UTC Flags needinfo?(idryomov)
Ilya Dryomov 2022-08-23 11:52:49 UTC Depends On 2120624
Shyamsundar 2022-08-23 13:43:52 UTC Doc Text .RBD mirror scheduling is getting stopped for some images

The Ceph manager daemon gets blocklisted due to different reasons, which causes the scheduled RBD mirror snapshot from being triggered on the cluster where the image(s) are primary. All RBD images that are mirror enabled (hence DR protected) do not list a schedule when examined using `rbd mirror snapshot schedule status -p ocs-storagecluster-cephblockpool`, and hence are not actively mirrored to the peer site.

Workaround: Restart the Ceph manager deployment, on the managed cluster where the images are primary, to overcome the blocklist against the currently running instance, this can be done by scaling down and then later scaling up the ceph manager deployment as follows:

$ oc -n openshift-storage scale deployments/rook-ceph-mgr-a --replicas=0

Result: Images that are DR enabled and denoted as primary on a managed cluster start reporting mirroring schedules when examined using `rbd mirror snapshot schedule status -p ocs-storagecluster-cephblockpool`
.RBD mirror scheduling is getting stopped for some images

The Ceph manager daemon gets blocklisted due to different reasons, which prevents further scheduled RBD mirror snapshots from being created on the cluster where the image(s) are primary. All RBD images that are mirror enabled (hence DR protected) do not list a schedule when examined using `rbd mirror snapshot schedule status -p ocs-storagecluster-cephblockpool`, and hence are not actively mirrored to the peer site.

Workaround: Restart the Ceph manager deployment, on the managed cluster where the images are primary, to overcome the blocklist against the currently running instance, this can be done by scaling down and then later scaling up the ceph manager deployment as follows:

$ oc -n openshift-storage scale deployments/rook-ceph-mgr-a --replicas=0
$ oc -n openshift-storage scale deployments/rook-ceph-mgr-a --replicas=1

Result: Images that are DR enabled and denoted as primary on a managed cluster start reporting mirroring schedules when examined using `rbd mirror snapshot schedule status -p ocs-storagecluster-cephblockpool`
Flags needinfo?(olakra)
Olive Lakra 2022-08-23 14:09:02 UTC Flags needinfo?(olakra) needinfo?(olakra)
krishnaram Karthick 2022-08-24 09:36:54 UTC Flags needinfo?(idryomov)
Ilya Dryomov 2022-08-24 10:01:33 UTC Flags needinfo?(idryomov)
Shyamsundar 2022-08-25 14:37:47 UTC Flags needinfo?(mrajanna)
CC mrajanna
krishnaram Karthick 2022-08-25 17:37:12 UTC Depends On 2121514
Madhu Rajanna 2022-08-29 05:07:08 UTC Flags needinfo?(mrajanna)
Mudit Agarwal 2022-10-21 05:11:14 UTC Depends On 1882534
RHEL Program Management 2022-11-14 13:12:37 UTC Target Release ODF 4.12.0 ---
umanga 2022-12-13 04:21:48 UTC Flags needinfo?(uchapaga)
RHEL Program Management 2022-12-20 07:27:34 UTC Target Release --- ODF 4.13.0
Red Hat Bugzilla 2022-12-31 19:21:10 UTC CC sagrawal
Red Hat Bugzilla 2022-12-31 19:22:34 UTC QA Contact prsurve nberry
Red Hat Bugzilla 2022-12-31 19:46:41 UTC CC uchapaga
Red Hat Bugzilla 2022-12-31 19:54:44 UTC QA Contact nberry
Red Hat Bugzilla 2022-12-31 20:00:23 UTC CC olakra
Red Hat Bugzilla 2022-12-31 20:04:20 UTC CC amagrawa
Red Hat Bugzilla 2022-12-31 22:33:44 UTC CC owasserm
Red Hat Bugzilla 2022-12-31 23:39:38 UTC CC idryomov
Assignee idryomov sostapov
Red Hat Bugzilla 2022-12-31 23:45:34 UTC CC kseeger
Red Hat Bugzilla 2023-01-01 05:47:17 UTC CC flucifre
Red Hat Bugzilla 2023-01-01 05:47:53 UTC CC srangana
Red Hat Bugzilla 2023-01-01 06:01:57 UTC CC bniver
Red Hat Bugzilla 2023-01-01 08:30:28 UTC CC jespy
Red Hat Bugzilla 2023-01-01 08:32:14 UTC CC kramdoss
Red Hat Bugzilla 2023-01-01 08:42:50 UTC CC sostapov
Assignee sostapov nobody
Red Hat Bugzilla 2023-01-01 08:45:36 UTC CC vashastr
Alasdair Kergon 2023-01-04 04:41:16 UTC Assignee nobody idryomov
Alasdair Kergon 2023-01-04 04:42:51 UTC CC amagrawa
Alasdair Kergon 2023-01-04 04:47:13 UTC QA Contact prsurve
Alasdair Kergon 2023-01-04 04:59:56 UTC CC jespy
Alasdair Kergon 2023-01-04 05:07:00 UTC CC kramdoss
Alasdair Kergon 2023-01-04 05:08:18 UTC CC kseeger
Alasdair Kergon 2023-01-04 05:25:54 UTC CC olakra
Alasdair Kergon 2023-01-04 05:26:53 UTC CC owasserm
Alasdair Kergon 2023-01-04 05:39:37 UTC CC sagrawal
Alasdair Kergon 2023-01-04 05:43:50 UTC CC sostapov
Alasdair Kergon 2023-01-04 05:46:39 UTC CC srangana
Alasdair Kergon 2023-01-04 05:53:02 UTC CC uchapaga
Alasdair Kergon 2023-01-04 05:53:49 UTC CC vashastr
Alasdair Kergon 2023-01-04 06:11:25 UTC CC bniver
Alasdair Kergon 2023-01-04 06:43:51 UTC CC flucifre
Alasdair Kergon 2023-01-04 06:46:24 UTC CC idryomov
Red Hat Bugzilla 2023-01-31 23:37:18 UTC CC madam
Sunil Kumar Acharya 2023-04-10 12:32:08 UTC Flags needinfo?(idryomov)
Ilya Dryomov 2023-04-11 12:25:32 UTC Summary [RDR] [tracker for BZ 2069720] rbd mirror scheduling is getting stopped for some images [RDR] [tracker for BZ 2111364] rbd mirror scheduling is getting stopped for some images
Ilya Dryomov 2023-04-11 12:27:43 UTC Flags needinfo?(idryomov)
Assignee idryomov rraja
Ilya Dryomov 2023-04-11 12:33:07 UTC CC sheggodu
Flags needinfo?(sheggodu)
Sunil Kumar Acharya 2023-04-11 12:37:10 UTC Flags needinfo?(sheggodu)
Mudit Agarwal 2023-05-15 17:48:45 UTC Fixed In Version 4.11.0-107 4.13.0-198
Status ASSIGNED ON_QA
Red Hat Bugzilla 2023-05-31 23:37:35 UTC CC mrajanna
Sunil Kumar Acharya 2023-06-01 15:29:09 UTC Blocks 2154341
Mudit Agarwal 2023-06-02 10:56:02 UTC Flags needinfo?(rraja)
Doc Text .RBD mirror scheduling is getting stopped for some images

The Ceph manager daemon gets blocklisted due to different reasons, which prevents further scheduled RBD mirror snapshots from being created on the cluster where the image(s) are primary. All RBD images that are mirror enabled (hence DR protected) do not list a schedule when examined using `rbd mirror snapshot schedule status -p ocs-storagecluster-cephblockpool`, and hence are not actively mirrored to the peer site.

Workaround: Restart the Ceph manager deployment, on the managed cluster where the images are primary, to overcome the blocklist against the currently running instance, this can be done by scaling down and then later scaling up the ceph manager deployment as follows:

$ oc -n openshift-storage scale deployments/rook-ceph-mgr-a --replicas=0
$ oc -n openshift-storage scale deployments/rook-ceph-mgr-a --replicas=1

Result: Images that are DR enabled and denoted as primary on a managed cluster start reporting mirroring schedules when examined using `rbd mirror snapshot schedule status -p ocs-storagecluster-cephblockpool`
Doc Type Known Issue Bug Fix
CC rraja
Ram Raja 2023-06-02 20:51:23 UTC Doc Type Bug Fix No Doc Update
Flags needinfo?(rraja)
Mudit Agarwal 2023-06-09 02:49:01 UTC Flags needinfo?(rraja)
Doc Type No Doc Update Bug Fix
Ilya Dryomov 2023-06-09 10:55:37 UTC Flags needinfo?(rraja) needinfo?(muagarwa)
Mudit Agarwal 2023-06-09 12:47:34 UTC Flags needinfo?(muagarwa) needinfo?(sheggodu)
Doc Type Bug Fix No Doc Update
Blocks 2154341
Red Hat Bugzilla 2023-06-09 12:47:34 UTC Doc Type No Doc Update No Doc Update
Sunil Kumar Acharya 2023-06-12 13:25:33 UTC Flags needinfo?(sheggodu)
Elad 2023-06-19 06:01:23 UTC CC ebenahar
RHEL Program Management 2023-06-19 06:01:35 UTC Target Release ODF 4.13.0 ---
Ilya Dryomov 2023-07-11 12:53:35 UTC Fixed In Version 4.13.0-198
Status ON_QA ASSIGNED
Summary [RDR] [tracker for BZ 2111364] rbd mirror scheduling is getting stopped for some images [RDR] [tracker for BZ 2111364 and BZ 2211290] rbd mirror scheduling is getting stopped for some images
Ilya Dryomov 2023-07-11 12:55:43 UTC CC ekuric
Ilya Dryomov 2023-07-31 11:44:08 UTC Flags needinfo?(ekuric)
Red Hat Bugzilla 2023-07-31 21:50:22 UTC CC vashastr
Red Hat Bugzilla 2023-08-03 08:29:51 UTC CC ocs-bugs
Elad 2023-08-09 16:37:41 UTC CC odf-bz-bot
RHEL Program Management 2023-08-11 15:05:28 UTC Target Release --- ODF 4.14.0

Back to bug 2067095