Bug 2136230

Summary: [RDR] DRPC and VRG reports different lastGroupSyncTime
Product: [Red Hat Storage] Red Hat OpenShift Data Foundation Reporter: Sidhant Agrawal <sagrawal>
Component: odf-drAssignee: Shyamsundar <srangana>
odf-dr sub component: ramen QA Contact: Sidhant Agrawal <sagrawal>
Status: CLOSED CURRENTRELEASE Docs Contact:
Severity: high    
Priority: unspecified CC: kramdoss, mrajanna, muagarwa, ocs-bugs, odf-bz-bot, srangana
Version: 4.12   
Target Milestone: ---   
Target Release: ODF 4.12.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: 4.12.0-100 Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of:
: 2140697 (view as bug list) Environment:
Last Closed: 2023-02-08 14:06:28 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2140697    

Description Sidhant Agrawal 2022-10-19 16:52:56 UTC 
Description of problem (please be detailed as possible and provide log
snippests):
DRPC on hub custer and VRG on managed cluster reports different lastGroupSyncTime.
It seems DRPC status lags behind the VRG status

For eg. Consider the following outputs of VRG and DRPC along with lastGroupSyncTime from it's yaml output, where the workload consists of 20 PVCs and Sync schedule of DRPolicy is 5m
================================================
VRG:
...
Wed Oct 19 16:03:05 UTC 2022
NAMESPACE             NAME           DESIREDSTATE   CURRENTSTATE
busybox-workloads-1   busybox-drpc   primary        Primary
    lastGroupSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
      lastSyncTime: "2022-10-19T15:55:02Z"
      lastSyncTime: "2022-10-19T15:55:01Z"
...

DRPC:
...
Wed Oct 19 16:03:27 UTC 2022
NAMESPACE             NAME           AGE   PREFERREDCLUSTER   FAILOVERCLUSTER   DESIREDSTATE   CURRENTSTATE   PROGRESSION   START TIME             DURATION        PEER READY
busybox-workloads-1   busybox-drpc   99m   sagrawal-c1                                         Deployed       Completed     2022-10-19T14:24:04Z   30.045531309s   True
    lastGroupSyncTime: "2022-10-19T15:45:00Z"
...

================================================
VRG:
...
Wed Oct 19 16:07:20 UTC 2022
NAMESPACE             NAME           DESIREDSTATE   CURRENTSTATE
busybox-workloads-1   busybox-drpc   primary        Primary
    lastGroupSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
      lastSyncTime: "2022-10-19T16:00:01Z"
      lastSyncTime: "2022-10-19T16:00:00Z"
...

DRPC:
...
Wed Oct 19 16:08:44 UTC 2022
NAMESPACE             NAME           AGE    PREFERREDCLUSTER   FAILOVERCLUSTER   DESIREDSTATE   CURRENTSTATE   PROGRESSION   START TIME             DURATION        PEER READY
busybox-workloads-1   busybox-drpc   104m   sagrawal-c1                                         Deployed       Completed     2022-10-19T14:24:04Z   30.045531309s   True
    lastGroupSyncTime: "2022-10-19T15:55:01Z"
...

================================================
VRG:
...
Wed Oct 19 16:47:47 UTC 2022
NAMESPACE             NAME           DESIREDSTATE   CURRENTSTATE
busybox-workloads-1   busybox-drpc   primary        Primary
    lastGroupSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
      lastSyncTime: "2022-10-19T16:40:01Z"
      lastSyncTime: "2022-10-19T16:40:00Z"
...

DRPC:
...
Wed Oct 19 16:48:58 UTC 2022
NAMESPACE             NAME           AGE    PREFERREDCLUSTER   FAILOVERCLUSTER   DESIREDSTATE   CURRENTSTATE   PROGRESSION   START TIME             DURATION        PEER READY
busybox-workloads-1   busybox-drpc   144m   sagrawal-c1                                         Deployed       Completed     2022-10-19T14:24:04Z   30.045531309s   True
    lastGroupSyncTime: "2022-10-19T16:35:00Z"
...


Version of all relevant components (if applicable):
OCP: 4.12.0-0.nightly-2022-10-18-192348
ODF: 4.12.0-77
ACM: 2.6.1
Submariner: 0.13.0

Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?

Is there any workaround available to the best of your knowledge?
No

Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?
2

Can this issue reproducible?
Yes

Can this issue reproduce from the UI?

If this is a regression, please provide more details to justify this:

Steps to Reproduce:
1. Configure RDR setup
2. Deploy an application containing multiple PVCs/Pods 
3. Check DRPC and VRG status at different intervals and compare the lastGroupSyncTime

Actual results:
DRPC and VRG reports different lastGroupSyncTime

Expected results:
DRPC and VRG should report same lastGroupSyncTime

Additional info: