Back to bug 1752130

Who When What Removed Added
RHEL Program Management 2019-09-13 19:29:29 UTC Keywords FutureFeature
Vikhyat Umrao 2019-09-13 19:29:48 UTC Link ID Ceph Project Bug Tracker 41828
Vikhyat Umrao 2019-09-13 19:41:47 UTC Severity unspecified high
Vikhyat Umrao 2019-09-13 19:56:52 UTC CC ivancich
Flags needinfo?(ivancich)
Matt Benjamin (redhat) 2019-09-13 20:24:21 UTC Status NEW ASSIGNED
Assignee mbenjamin ivancich
J. Eric Ivancich 2019-09-13 20:32:32 UTC Flags needinfo?(ivancich)
Justin Bautista 2019-09-18 19:02:50 UTC Target Release 4.* 2.*
CC tserlin
CC jbautist
J. Eric Ivancich 2019-09-20 02:31:09 UTC CC yehuda
J. Eric Ivancich 2019-09-20 02:34:22 UTC Flags needinfo?(yehuda)
J. Eric Ivancich 2019-09-20 02:58:38 UTC Flags needinfo?(vumrao)
Vikhyat Umrao 2019-09-20 15:55:32 UTC Flags needinfo?(yehuda) needinfo?(vumrao)
Vikhyat Umrao 2019-09-20 15:56:16 UTC Flags needinfo?(yehuda)
J. Eric Ivancich 2019-09-20 21:55:52 UTC Flags needinfo?(mbenjamin)
Justin Bautista 2019-09-25 03:25:24 UTC Flags needinfo?(tserlin)
J. Eric Ivancich 2019-09-25 04:44:18 UTC Flags needinfo?(vumrao)
J. Eric Ivancich 2019-09-25 04:53:25 UTC Flags needinfo?(jbautist)
Vikhyat Umrao 2019-09-25 05:50:46 UTC Flags needinfo?(tserlin)
Flags needinfo?(yehuda) needinfo?(mbenjamin) needinfo?(vumrao) needinfo?(jbautist)
Vikhyat Umrao 2019-09-25 05:51:44 UTC Flags needinfo?(jbautist)
Justin Bautista 2019-09-25 16:21:57 UTC Flags needinfo?(jbautist)
David Wood 2019-09-27 16:44:41 UTC CC dwood
Flags needinfo?(vumrao)
David Wood 2019-09-27 16:59:49 UTC Flags needinfo?(ivancich)
J. Eric Ivancich 2019-09-27 17:07:17 UTC Flags needinfo?(vumrao) needinfo?(ivancich) needinfo?(dwood)
David Wood 2019-09-30 15:16:48 UTC Flags needinfo?(dwood)
David Wood 2019-09-30 15:19:49 UTC Flags needinfo?(ivancich)
J. Eric Ivancich 2019-09-30 18:40:13 UTC Flags needinfo?(ivancich) needinfo?(dwood)
Justin Bautista 2019-10-01 17:53:23 UTC Flags needinfo?(dwood)
Justin Bautista 2019-10-02 00:18:13 UTC Flags needinfo?(ivancich)
J. Eric Ivancich 2019-10-08 21:40:47 UTC Flags needinfo?(ivancich) needinfo?(jbautist)
Justin Bautista 2019-10-09 16:23:30 UTC Flags needinfo?(jbautist)
Justin Bautista 2019-10-09 16:25:25 UTC Flags needinfo?(ivancich)
J. Eric Ivancich 2019-10-15 19:12:12 UTC Flags needinfo?(ivancich)
Mike Hackett 2019-10-16 20:47:31 UTC CC mhackett
Tejas 2019-11-11 10:09:52 UTC Flags needinfo?(ivancich) needinfo?(vumrao)
Vikhyat Umrao 2019-11-11 14:48:46 UTC Target Release 2.* 3.3
Target Milestone rc z3
Vikhyat Umrao 2019-11-11 14:49:32 UTC Flags needinfo?(ivancich) needinfo?(vumrao)
Vikhyat Umrao 2019-11-11 14:54:21 UTC Blocks 1770955
Justin Bautista 2019-12-16 03:04:36 UTC Flags needinfo?(ivancich)
J. Eric Ivancich 2019-12-16 20:06:21 UTC Flags needinfo?(ivancich)
Yaniv Kaul 2019-12-17 18:19:35 UTC Flags needinfo?(ivancich)
J. Eric Ivancich 2019-12-17 22:18:45 UTC Flags needinfo?(ivancich)
J. Eric Ivancich 2019-12-17 22:29:35 UTC Flags needinfo?(mbenjamin)
J. Eric Ivancich 2019-12-17 23:18:17 UTC Flags needinfo?(vumrao)
J. Eric Ivancich 2019-12-20 21:56:49 UTC Flags needinfo?(mhackett)
Vikhyat Umrao 2019-12-30 06:38:45 UTC Flags needinfo?(vumrao)
J. Eric Ivancich 2020-01-22 18:39:06 UTC Flags needinfo?(mhackett)
J. Eric Ivancich 2020-01-22 18:40:24 UTC Flags needinfo?(mbenjamin) needinfo?(mhackett) needinfo- needinfo-
J. Eric Ivancich 2020-01-22 18:41:15 UTC Flags needinfo- needinfo-
Vikhyat Umrao 2020-01-22 19:55:56 UTC Flags needinfo?(ivancich)
J. Eric Ivancich 2020-01-22 21:41:36 UTC Flags needinfo?(ivancich)
Matt Benjamin (redhat) 2020-02-19 16:12:50 UTC Priority unspecified medium
Ken Dreyer (Red Hat) 2020-02-19 21:52:47 UTC Target Milestone z3 z4
J. Eric Ivancich 2020-02-21 21:45:41 UTC Flags needinfo?(mbenjamin)
Status ASSIGNED POST
Tejas 2020-02-24 07:05:05 UTC Flags needinfo?(mbenjamin)
Status POST MODIFIED
Fixed In Version RHEL: ceph-12.2.12-96.el7cp Ubuntu: ceph_12.2.12-91redhat1
CC ceph-qe-bugs
Flags needinfo?(ceph-qe-bugs)
Flags needinfo?(mhackett) needinfo?(ceph-qe-bugs)
errata-xmlrpc 2020-02-24 16:20:35 UTC Status MODIFIED ON_QA
Ranjini M N 2020-03-04 10:34:12 UTC CC rmandyam
Blocks 1726135
Doc Type If docs needed, set a value Enhancement
Flags needinfo?(ivancich)
J. Eric Ivancich 2020-03-04 18:30:24 UTC Doc Text Feature:

This adds two new, related features. The first is that radosgw-admin now has a "radoslist" subcommand that can optionally take a bucket as a command-line argument. If a bucket is provided then it lists out the rados objects that hold the data for all rgw objects in the bucket. If a bucket is not provided it does the same, but for all buckets.

Additionally it adds a new command-line tool -- rgw-orphan-list. It will prompt the admin for a pool (the data pool SHOULD be chosen), and it will produce a list of all orphans on that pool.

This could be a potential list of rados objects that were leaked and could possibly be deleted. However if a non-data pool was chosen, the list is invalid and should not be used for such purposes.

Reason:

Bugs in past version of RGW have left orphan objects behind, and these consume space. Although radosgw-admin provides "orphans find" and "orphans finish" subcommands, these have issues. 1. They have not been regularly updated over time and some have doubted their correctness. 2. It stores intermediate results on the cluster itself, so admins who have a nearly full cluster that they would like to recover space on by removing orphans might ultimately fill up the cluster. With the tools here, all intermediate results are kept on the local file system of the machine they're issued from.

Result:

Admins now have a way to see how RGW objects map to rados objects and have a way to produce potential lists of orphans for further processing.
Flags needinfo?(ivancich)
Ranjini M N 2020-03-10 09:31:02 UTC Docs Contact rmandyam
Anjana Suparna Sriram 2020-03-11 08:01:48 UTC Blocks 1812375
Ranjini M N 2020-03-17 10:53:43 UTC Doc Text Feature:

This adds two new, related features. The first is that radosgw-admin now has a "radoslist" subcommand that can optionally take a bucket as a command-line argument. If a bucket is provided then it lists out the rados objects that hold the data for all rgw objects in the bucket. If a bucket is not provided it does the same, but for all buckets.

Additionally it adds a new command-line tool -- rgw-orphan-list. It will prompt the admin for a pool (the data pool SHOULD be chosen), and it will produce a list of all orphans on that pool.

This could be a potential list of rados objects that were leaked and could possibly be deleted. However if a non-data pool was chosen, the list is invalid and should not be used for such purposes.

Reason:

Bugs in past version of RGW have left orphan objects behind, and these consume space. Although radosgw-admin provides "orphans find" and "orphans finish" subcommands, these have issues. 1. They have not been regularly updated over time and some have doubted their correctness. 2. It stores intermediate results on the cluster itself, so admins who have a nearly full cluster that they would like to recover space on by removing orphans might ultimately fill up the cluster. With the tools here, all intermediate results are kept on the local file system of the machine they're issued from.

Result:

Admins now have a way to see how RGW objects map to rados objects and have a way to produce potential lists of orphans for further processing.
.New commands to view the RADOS objects and orphans

This release adds two new commands to view how Object Gateway maps to RADOS objects and produce a potential list of orphans for further processing.The `radosgw-admin radoslist <bucket>` command lists all RADOS objects in the bucket. The `rgw-orphan-list` command lists all orphans in a specified pool. These commands keep intermediate results on the local file system.
Flags needinfo?(ivancich)
Ranjini M N 2020-03-18 11:47:10 UTC Doc Text .New commands to view the RADOS objects and orphans

This release adds two new commands to view how Object Gateway maps to RADOS objects and produce a potential list of orphans for further processing.The `radosgw-admin radoslist <bucket>` command lists all RADOS objects in the bucket. The `rgw-orphan-list` command lists all orphans in a specified pool. These commands keep intermediate results on the local file system.
.New commands to view the RADOS objects and orphans

This release adds two new commands to view how Object Gateway maps to RADOS objects and produce a potential list of orphans for further processing. The `radosgw-admin radoslist <bucket>` command lists all RADOS objects in the bucket. The `rgw-orphan-list` command lists all orphans in a specified pool. These commands keep intermediate results on the local file system.
J. Eric Ivancich 2020-03-19 19:07:17 UTC Blocks 1815211
Uday kurundwade 2020-03-26 03:03:31 UTC CC ukurundw
QA Contact tchandra ukurundw
Uday kurundwade 2020-03-26 06:28:20 UTC Status ON_QA VERIFIED
Ranjini M N 2020-03-26 10:41:32 UTC Doc Text .New commands to view the RADOS objects and orphans

This release adds two new commands to view how Object Gateway maps to RADOS objects and produce a potential list of orphans for further processing. The `radosgw-admin radoslist <bucket>` command lists all RADOS objects in the bucket. The `rgw-orphan-list` command lists all orphans in a specified pool. These commands keep intermediate results on the local file system.
.New commands to view the RADOS objects and orphans


This release adds two new commands to view how Object Gateway maps to RADOS objects and produce a potential list of orphans for further processing. The `radosgw-admin radoslist <bucket>` command lists all RADOS objects in the bucket. The `rgw-orphan-list` command lists all orphans in a specified pool. These commands keep intermediate results on the local file system.
Ranjini M N 2020-03-26 10:45:24 UTC Depends On 1805376
Ranjini M N 2020-03-26 10:53:58 UTC Flags needinfo?(ivancich) needinfo-
errata-xmlrpc 2020-04-03 16:41:46 UTC Status VERIFIED RELEASE_PENDING
errata-xmlrpc 2020-04-06 08:27:04 UTC Status RELEASE_PENDING CLOSED
Resolution --- ERRATA
Last Closed 2020-04-06 08:27:04 UTC
errata-xmlrpc 2020-04-06 08:27:46 UTC Link ID Red Hat Product Errata RHBA-2020:1320
Ranjini M N 2020-04-09 06:15:02 UTC Doc Text .New commands to view the RADOS objects and orphans


This release adds two new commands to view how Object Gateway maps to RADOS objects and produce a potential list of orphans for further processing. The `radosgw-admin radoslist <bucket>` command lists all RADOS objects in the bucket. The `rgw-orphan-list` command lists all orphans in a specified pool. These commands keep intermediate results on the local file system.
.New commands to view the RADOS objects and orphans


This release adds two new commands to view how Object Gateway maps to RADOS objects and produce a potential list of orphans for further processing. The `radosgw-admin bucket radoslist --bucket=<bucket_name>` command lists all RADOS objects in the bucket. The `rgw-orphan-list` command lists all orphans in a specified pool. These commands keep intermediate results on the local file system.
Ranjini M N 2020-04-09 06:49:55 UTC Blocks 1821884

Back to bug 1752130