Bug 2270322 - [RFE] QoLife improvements for "/usr/bin/rgw-restore-bucket-index" tool 6.1z6
Summary: [RFE] QoLife improvements for "/usr/bin/rgw-restore-bucket-index" tool 6.1z6
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 6.1
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: 6.1z7
Assignee: J. Eric Ivancich
QA Contact: Madhavi Kasturi
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2024-03-19 16:49 UTC by J. Eric Ivancich
Modified: 2024-08-28 17:58 UTC (History)
5 users (show)

Fixed In Version: ceph-17.2.6-244
Doc Type: Enhancement
Doc Text:
.Improved temporary file placement and error messages for the with the ‘/usr/bin/rgw-restore-bucket-index' tool Previously, the ‘/usr/bin/rgw-restore-bucket-index' tool only placed temporary files into the ‘/tmp’ directory. This could lead to issues if the directory ran out of space, resulting in the following error messing being emitted: "ln: failed to access '/tmp/rgwrbi-object-list.XXX': No such file or directory". With this enhancement, users can now specify a specific directory to place temporary files, by using the ‘-t’ command-line option. Additionally, if the specified directory is full, users now receive an error message specifying the problem: “ERROR: the temporary directory's partition is full, preventing continuation”.
Clone Of:
Environment:
Last Closed: 2024-08-28 17:58:51 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHCEPH-8561 0 None None None 2024-03-19 16:50:41 UTC
Red Hat Product Errata RHBA-2024:5960 0 None None None 2024-08-28 17:58:54 UTC

Description J. Eric Ivancich 2024-03-19 16:49:06 UTC
This bug was initially created as a copy of Bug #2267715

I am copying this bug because: 



Description of problem:
Based on the experience from the field the "/usr/bin/rgw-restore-bucket-index" tool stores temporary objects in /tmp directory, these objects consumes space based on the size of the bucket that is being recovered, for large buckets this can eventually lead to "/usr/bin/rgw-restore-bucket-index" tool failure due to running out of space, but the error message does not suggest that is the case, but rather fails with 
"ln: failed to access '/tmp/rgwrbi-object-list.XXX': No such file or directory"


With that information, would it make sense to consider 2 improvements of the "/usr/bin/rgw-restore-bucket-index" tool:
1. add option for custom path where the files will be stored
2. add detection of running out of space

Version-Release number of selected component (if applicable):
RHCS 5, 6, 7

How reproducible:
always

Steps to Reproduce:
1. have 4GB large /tmp
2. attempt to recover bucket with 17M objects


Actual results:


Expected results:


Additional info:

Comment 1 RHEL Program Management 2024-03-19 16:49:14 UTC
Please specify the severity of this bug. Severity is defined here:
https://bugzilla.redhat.com/page.cgi?id=fields.html#bug_severity.

Comment 2 J. Eric Ivancich 2024-03-19 16:50:39 UTC
Waiting for 6.1z5 to go out the door before cherry-picking two commits.

Comment 3 J. Eric Ivancich 2024-03-19 16:52:38 UTC
We need to pull the commits from 2 upstream PRs:

https://github.com/ceph/ceph/pull/55885
https://github.com/ceph/ceph/pull/56133

Comment 11 errata-xmlrpc 2024-08-28 17:58:51 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 6.1 security, bug fix, and enhancement updates.), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2024:5960


Note You need to log in before you can comment on or make changes to this bug.