Bug 1749090 - RGW bucket sharding heavy uneven distribution of omap keys b/w bucket shards objects
Summary: RGW bucket sharding heavy uneven distribution of omap keys b/w bucket shards ...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 3.3
Hardware: x86_64
OS: Linux
high
high
Target Milestone: z2
: 4.1
Assignee: J. Eric Ivancich
QA Contact: Tejas
URL:
Whiteboard:
Depends On:
Blocks: 1816167
TreeView+ depends on / blocked
 
Reported: 2019-09-04 20:55 UTC by Vikhyat Umrao
Modified: 2025-04-04 12:20 UTC (History)
20 users (show)

Fixed In Version: ceph-14.2.8-94.el8cp, ceph-14.2.8-94.el7cp
Doc Type: Bug Fix
Doc Text:
.Uneven distribution of omap keys with bucket shard objects In versioned buckets, occasionally delete object operations were unable to fully complete. In this state, the bucket index entries for these objects had their name and instance strings zeroed out. When there was a subsequent reshard, the empty name and instance strings caused the entry to be resharded to shard 0. Entries that did not belong on shard 0 ended up there. This put a disproportionate number of entries on shard 0 and was larger than each other shard. With this release, the name and instance strings are no longer cleared during this portion of the delete operation. If a reshard takes place, the entries that were not fully deleted nonetheless end up on the correct shard and are not forced to shard 0.
Clone Of:
Environment:
Last Closed: 2020-09-30 17:24:49 UTC
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Ceph Project Bug Tracker 46456 0 None None None 2020-07-10 17:13:43 UTC
Github ceph ceph pull 36015 0 None closed cls/rgw: preserve olh entry's name on last unlink 2020-12-01 17:27:00 UTC
Red Hat Product Errata RHBA-2020:4144 0 None None None 2020-09-30 17:25:27 UTC

Comment 59 jmundackal 2020-08-26 13:47:26 UTC 
can the comments on this made public? (am assuming there are a bunch of notes on this)
Comment 69 errata-xmlrpc 2020-09-30 17:24:49 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 4.1 Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4144
Comment 70 TypingArtist 2024-11-11 06:14:23 UTC Comment hidden (spam)
Comment 71 dora87booth 2024-12-18 05:33:42 UTC 
Bug 1749090 addresses an issue in RGW (RADOS Gateway) where there's a heavy uneven distribution of omap (Object Metadata) keys across bucket shards. This can lead to performance problems and inefficiencies in data management. The bug report suggests that dynamic resharding might not be functioning correctly or that the bucket indexes have become too large for the current configuration to handle effectively https://www.kmfusafinance.com
Note You need to log in before you can comment on or make changes to this bug.