Bug 1925344 - Bucket index entries and object names with trailing NUL character on re-uploaded multiparts
Summary: Bucket index entries and object names with trailing NUL character on re-uploa...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 3.3
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: 5.0
Assignee: Matt Benjamin (redhat)
QA Contact: Tejas
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-02-04 22:27 UTC by Mike Hackett
Modified: 2024-12-20 19:36 UTC (History)
11 users (show)

Fixed In Version: ceph-16.1.0-486.el8cp
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1929905 (view as bug list)
Environment:
Last Closed: 2021-08-30 08:28:17 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github ceph ceph pull 39445 0 None open pacific: rgw: fix trailing null in object names of multipart reuploads 2021-02-16 22:00:15 UTC
Red Hat Issue Tracker RHCEPH-1234 0 None None None 2021-08-30 00:18:21 UTC
Red Hat Product Errata RHBA-2021:3294 0 None None None 2021-08-30 08:28:39 UTC

Description Mike Hackett 2021-02-04 22:27:14 UTC
Description of problem:
## Issue
In object storage with radosgw, accumulating large quantities of objects in the data pool that appear to be orphans. Since this is a large cluster(2PB), customer cannot execute the command "radosgw-admin orphans find". It is taking VERY long time.

## Subscription Details
- As per the SKU --SVCRC12E4000, customer having ceph subscription.

## Environment 
* ceph version 12.2.12 (1436006594665279fe734b4c15d7e08c13ebd777) luminous (stable)


## Root cause
* The issues with the `orphans find` and `bucket check --fix` issues have the same root cause ie reuploaded multiparts.
* The `orphan find` command removes (or is supposed to remove) the leaked reuploaded parts from the bucket data pool, and the `bucket check --fix` command should remove the leaked reuploaded parts from the bucket index.
* Both sets of functionality are required to remediate the issues caused by user reuploading parts in a multipart upload.

## Summary / Tracker /PR
http://tracker.ceph.com/issues/38454
https://tracker.ceph.com/issues/44722
https://tracker.ceph.com/issues/49018

https://github.com/ceph/ceph/pull/34148
https://github.com/ceph/ceph/pull/35005 
https://github.com/ceph/ceph/pull/37260
https://github.com/ceph/ceph/pull/38905

Version-Release number of selected component (if applicable):
3.3

Related tool request: https://bugzilla.redhat.com/show_bug.cgi?id=1925342

Comment 6 errata-xmlrpc 2021-08-30 08:28:17 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 5.0 bug fix and enhancement), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:3294


Note You need to log in before you can comment on or make changes to this bug.