Bug 2145022

Summary: rgw: reports of put ops recreating former bucket index objects after resharding
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: J. Eric Ivancich <ivancich>
Component: RGWAssignee: J. Eric Ivancich <ivancich>
Status: CLOSED ERRATA QA Contact: Anuchaithra <anrao>
Severity: high Docs Contact: Akash Raj <akraj>
Priority: unspecified    
Version: 5.2CC: akraj, anrao, cbodley, ceph-eng-bugs, cephqe-warriors, kbader, kkeithle, mbenjamin, mkasturi, vereddy, vimishra
Target Milestone: ---   
Target Release: 5.3   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ceph-16.2.10-78.el8cp Doc Type: Bug Fix
Doc Text:
.PUT object operation writes to the correct bucket index shards Previously, due to a race condition, a PUT object operation would rarely write to a former bucket index shard. This caused the former bucket index shard to be recreated, and the object would not appear in the proper bucket index. Therefore, the object would not be listed when the bucket was listed. With this fix, care is taken to prevent various operations from creating bucket index shards and recover when the race condition is encountered. PUT object operations now always write to the correct bucket index shards.
 Story Points: ---
Clone Of: Environment:
Last Closed: 2023-01-11 17:42:24 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2126049    

Description J. Eric Ivancich 2022-11-22 23:04:09 UTC 
Description of problem:

On pacific we had reports of heavy PUT workloads recreating former bucket index objects. Although this has not been reproduced in upstream main or ceph 5.x, we believe that potential still exists.


Version-Release number of selected component (if applicable):


How reproducible: Difficult


Steps to Reproduce:
1. On pacific was reproduced when under heavy PUT OBJ workload resharding would occur.
2. There's speculation that another worthwhile test would be a recursive bucket delete while same bucket under heavy PUT OBJ workload.
3.

Actual results:

Formerly deleted bucket index objects are recreated with data for newly PUT objects.

Expected results:

Newly PUT objects should appear in the bucket index objects created as a result of resharding.

Additional info:
Comment 1 RHEL Program Management 2022-11-22 23:04:21 UTC 
Please specify the severity of this bug. Severity is defined here:
https://bugzilla.redhat.com/page.cgi?id=fields.html#bug_severity.
Comment 29 errata-xmlrpc 2023-01-11 17:42:24 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat Ceph Storage 5.3 security update and Bug Fix), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2023:0076
Comment 30 Red Hat Bugzilla 2023-09-19 04:30:21 UTC 
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days