Bug 1760854 - RGW archive zone do not generate new versions when the object is exactly the same
Summary: RGW archive zone do not generate new versions when the object is exactly the ...
Keywords:
Status: CLOSED WONTFIX
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 5.0
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: 6.1
Assignee: shilpa
QA Contact: Madhavi Kasturi
URL:
Whiteboard:
: 2210132 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-10-11 13:58 UTC by Mike Hackett
Modified: 2023-11-15 04:25 UTC (History)
11 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2023-03-26 18:11:07 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHCEPH-2561 0 None None None 2021-12-09 06:45:23 UTC

Description Mike Hackett 2019-10-11 13:58:49 UTC
Description of problem:

If the object is modified but it is the same object, do not generate a new version. Just discard the operation or update metadata:

  -With simple uploads, if the ETag header is the same:
     -Option 1: Discard the operation.
     -Option 2: Update only metadata (i.e: LastModified field) but not the object content itself.
  -With multipart uploads, if the ETag header of the final object is the same:
     -Option 1: Discard the operation.
     -Option 2: Update only metadata (i.e: LastModified field) but not the object content itself.
     -Partial uploads should be deleted to free up space in the RGW archive zone and clean up orphaned RADOS objects.
  -Some advantages of implementing this feature:
     -With the current behaviour, a user could upload the same object many times and totally fill up the RGW archive zone Ceph cluster.
     -If the ETag header check is done prior transferring the object and the operation is discarded, resource usage (network bandwidth, CPU, Memory, ...) will be reduced.

Comment 1 Mike Hackett 2019-10-11 14:01:22 UTC
Issue relevant to RGW archive zone.

Comment 8 Yaniv Kaul 2020-01-09 13:44:00 UTC
What's the status of this BZ?

Comment 9 shilpa 2020-01-11 05:25:33 UTC
(In reply to Yaniv Kaul from comment #8)
> What's the status of this BZ?

This might need to be considered for a later release, as we are yet to find an acceptable solution. Checking/comparing checksums of large number of object versions will involve an undesirable linear time complexity, unless we plan to cap the number of versions an object can have.

Comment 34 Matt Benjamin (redhat) 2023-07-17 16:57:49 UTC
*** Bug 2210132 has been marked as a duplicate of this bug. ***

Comment 35 Red Hat Bugzilla 2023-11-15 04:25:05 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days


Note You need to log in before you can comment on or make changes to this bug.