Bug 2102365

Summary: Setting rgw_data_notify_interval_msec=0 dos not disable async data notifications
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Adam C. Emerson <aemerson>
Component: RGW-MultisiteAssignee: Adam C. Emerson <aemerson>
Status: CLOSED ERRATA QA Contact: Tejas <tchandra>
Severity: high Docs Contact: Akash Raj <akraj>
Priority: unspecified    
Version: 5.2CC: akraj, ceph-eng-bugs, cephqe-warriors, mbenjamin, mkasturi, tserlin, vereddy
Target Milestone: ---   
Target Release: 5.2   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ceph-16.2.8-64.el8cp Doc Type: Bug Fix
Doc Text:
.Special handling is added for `rgw_data_notify_interval_msec=0` parameter Previously, `rgw_data_notify_interval_msec` had no special handling for 0, resulting in primary site flooding the secondary site with notifications.. With this fix, special handling for `rgw_data_notify_interval_msec=0` is added and async data notification can now be disabled.
 Story Points: ---
Clone Of: Environment:
Last Closed: 2022-08-09 17:39:24 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2102272    

Description Adam C. Emerson 2022-06-29 19:25:32 UTC 
This bug was initially created as a copy of Bug #2102358

I am copying this bug because: 



Description of problem:

In upstream Ceph we have found that async data notifications solve sync consistency problems. In downstream Ceph this seemed to have no effect or made it worse.

We recently discovered a patch that was originally introduced as part of the testing framework is required to make disabling async data notifications possible. Without it, attempting to disable them just resulted in more of them being sent more frequently.

Version-Release number of selected component (if applicable):

All 4.x and 5.x

How reproducible:

Deterministically.

Steps to Reproduce:
1. Set up a multisite cluster 
2. Set rgw_data_notify_interval_msec to 0
3. Ingest data into it

Actual results:

No async data notifications.

At level 20, the log does not show 'notifying datalog change' entries

Expected results:

Oh so many async data notifications.


At level 20, the log DOES show 'notifying datalog change'

Additional info:

As async data log notifications may be the ultimate root of sync inconsistency errors we've been seeing, this needs to be fixed so we can test disabling them properly.
Comment 14 errata-xmlrpc 2022-08-09 17:39:24 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat Ceph Storage Security, Bug Fix, and Enhancement Update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:5997