Bug 2102365 - Setting rgw_data_notify_interval_msec=0 dos not disable async data notifications
Summary: Setting rgw_data_notify_interval_msec=0 dos not disable async data notifications
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW-Multisite
Version: 5.2
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 5.2
Assignee: Adam C. Emerson
QA Contact: Tejas
Akash Raj
URL:
Whiteboard:
Depends On:
Blocks: 2102272
TreeView+ depends on / blocked
 
Reported: 2022-06-29 19:25 UTC by Adam C. Emerson
Modified: 2022-08-09 17:39 UTC (History)
7 users (show)

Fixed In Version: ceph-16.2.8-64.el8cp
Doc Type: Bug Fix
Doc Text:
.Special handling is added for `rgw_data_notify_interval_msec=0` parameter Previously, `rgw_data_notify_interval_msec` had no special handling for 0, resulting in primary site flooding the secondary site with notifications.. With this fix, special handling for `rgw_data_notify_interval_msec=0` is added and async data notification can now be disabled.
Clone Of:
Environment:
Last Closed: 2022-08-09 17:39:24 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHCEPH-4640 0 None None None 2022-06-29 19:47:04 UTC
Red Hat Product Errata RHSA-2022:5997 0 None None None 2022-08-09 17:39:54 UTC

Description Adam C. Emerson 2022-06-29 19:25:32 UTC
This bug was initially created as a copy of Bug #2102358

I am copying this bug because: 



Description of problem:

In upstream Ceph we have found that async data notifications solve sync consistency problems. In downstream Ceph this seemed to have no effect or made it worse.

We recently discovered a patch that was originally introduced as part of the testing framework is required to make disabling async data notifications possible. Without it, attempting to disable them just resulted in more of them being sent more frequently.

Version-Release number of selected component (if applicable):

All 4.x and 5.x

How reproducible:

Deterministically.

Steps to Reproduce:
1. Set up a multisite cluster 
2. Set rgw_data_notify_interval_msec to 0
3. Ingest data into it

Actual results:

No async data notifications.

At level 20, the log does not show 'notifying datalog change' entries

Expected results:

Oh so many async data notifications.


At level 20, the log DOES show 'notifying datalog change'

Additional info:

As async data log notifications may be the ultimate root of sync inconsistency errors we've been seeing, this needs to be fixed so we can test disabling them properly.

Comment 14 errata-xmlrpc 2022-08-09 17:39:24 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat Ceph Storage Security, Bug Fix, and Enhancement Update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:5997


Note You need to log in before you can comment on or make changes to this bug.