Bug 1749090

Summary: RGW bucket sharding heavy uneven distribution of omap keys b/w bucket shards objects
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Vikhyat Umrao <vumrao>
Component: RGWAssignee: J. Eric Ivancich <ivancich>
Status: CLOSED ERRATA QA Contact: Tejas <tchandra>
Severity: high Docs Contact:
Priority: high    
Version: 3.3CC: aagrawal159, agangopadhy2, agunn, cbodley, ceph-eng-bugs, dora87booth, hyelloji, ivancich, jmundackal, jzhu116, kbader, mamccoma, mbenjamin, mhackett, mleonard33, mlu136, rkallu, sweil, swu497, tserlin
Target Milestone: z2   
Target Release: 4.1   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: ceph-14.2.8-94.el8cp, ceph-14.2.8-94.el7cp Doc Type: Bug Fix
Doc Text:
.Uneven distribution of omap keys with bucket shard objects In versioned buckets, occasionally delete object operations were unable to fully complete. In this state, the bucket index entries for these objects had their name and instance strings zeroed out. When there was a subsequent reshard, the empty name and instance strings caused the entry to be resharded to shard 0. Entries that did not belong on shard 0 ended up there. This put a disproportionate number of entries on shard 0 and was larger than each other shard. With this release, the name and instance strings are no longer cleared during this portion of the delete operation. If a reshard takes place, the entries that were not fully deleted nonetheless end up on the correct shard and are not forced to shard 0.
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-09-30 17:24:49 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1816167    

Comment 59 jmundackal 2020-08-26 13:47:26 UTC
can the comments on this made public? (am assuming there are a bunch of notes on this)

Comment 69 errata-xmlrpc 2020-09-30 17:24:49 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 4.1 Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4144

Comment 70 TypingArtist 2024-11-11 06:14:23 UTC Comment hidden (spam)
Comment 71 dora87booth 2024-12-18 05:33:42 UTC
Bug 1749090 addresses an issue in RGW (RADOS Gateway) where there's a heavy uneven distribution of omap (Object Metadata) keys across bucket shards. This can lead to performance problems and inefficiencies in data management. The bug report suggests that dynamic resharding might not be functioning correctly or that the bucket indexes have become too large for the current configuration to handle effectively https://www.kmfusafinance.com