Bug 2102358

Summary: Setting rgw_data_notify_interval_msec=0 dos not disable async data notifications
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Adam C. Emerson <aemerson>
Component: RGW-MultisiteAssignee: Adam C. Emerson <aemerson>
Status: CLOSED ERRATA QA Contact: Tejas <tchandra>
Severity: high Docs Contact:
Priority: high    
Version: 4.1CC: anrao, ceph-eng-bugs, cephqe-warriors, mkasturi, tserlin, vimishra
Target Milestone: ---   
Target Release: 4.3z1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ceph-14.2.22-117.el8cp, ceph-14.2.22-117.el7cp Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-09-22 11:21:10 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Adam C. Emerson 2022-06-29 18:59:15 UTC 
Description of problem:

In upstream Ceph we have found that async data notifications solve sync consistency problems. In downstream Ceph this seemed to have no effect or made it worse.

We recently discovered a patch that was originally introduced as part of the testing framework is required to make disabling async data notifications possible. Without it, attempting to disable them just resulted in more of them being sent more frequently.

Version-Release number of selected component (if applicable):

All 4.x and 5.x

How reproducible:

Deterministically.

Steps to Reproduce:
1. Set up a multisite cluster 
2. Set rgw_data_notify_interval_msec to 0
3. Ingest data into it

Actual results:

No async data notifications.

At level 20, the log does not show 'notifying datalog change' entries

Expected results:

Oh so many async data notifications.


At level 20, the log DOES show 'notifying datalog change'

Additional info:

As async data log notifications may be the ultimate root of sync inconsistency errors we've been seeing, this needs to be fixed so we can test disabling them properly.
Comment 10 errata-xmlrpc 2022-09-22 11:21:10 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 4.3 Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:6684