Bug 2021600 - rgw: deleting and purging a bucket can get stuck in an endless loop 5.1
Summary: rgw: deleting and purging a bucket can get stuck in an endless loop 5.1
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 5.1
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 5.1
Assignee: J. Eric Ivancich
QA Contact: Madhavi Kasturi
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-11-09 17:41 UTC by J. Eric Ivancich
Modified: 2022-04-04 10:22 UTC (History)
7 users (show)

Fixed In Version: ceph-16.2.6-23.el8cp
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-04-04 10:22:28 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHCEPH-2207 0 None None None 2021-11-09 17:45:23 UTC
Red Hat Product Errata RHSA-2022:1174 0 None None None 2022-04-04 10:22:44 UTC

Description J. Eric Ivancich 2021-11-09 17:41:44 UTC
Description of problem:

This stems from upstream tracker: https://tracker.ceph.com/issues/52662 .

If all unfinished multipart upload ".meta" index entries cannot be retrieved in one go, the marker is not advanced and the listing will be stuck. This happens during the phase of bucket deletion/purge where it tries to abort all incomplete multipart uploads.


Version-Release number of selected component (if applicable):


How reproducible:

Very reproducible.


Steps to Reproduce:
1. Load up the bucket index with many thousands of entries in the _multipart_ namespace representing parts of incomplete multipart uploads. Add two entries that are in that namespace spread apart in the lexically (so there are thousands of entries in between) and end with ".meta" each representing one incomplete multipart upload.
2. Issue `radosgw-admin bucket rm --bucket=<bucket> --purge-objects --bypass-gc`

Actual results:

Command will never finished. If --debug-rgw=20 added, one will see the same bucket index entries re-visited multiple times in the log. Bucket will not be removed.

Expected results:

Command to complete, bucket removed.

Additional info:

Comment 1 J. Eric Ivancich 2021-11-09 17:42:27 UTC
Upstream PR: https://github.com/ceph/ceph/pull/43862

Comment 5 J. Eric Ivancich 2021-11-11 19:27:22 UTC
See comments 7 and 8 on https://bugzilla.redhat.com/show_bug.cgi?id=2021601 for a reproducer.

Comment 12 errata-xmlrpc 2022-04-04 10:22:28 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat Ceph Storage 5.1 Security, Enhancement, and Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:1174


Note You need to log in before you can comment on or make changes to this bug.