Bug 1639817 - RFE: S3 v2 RESTBucketGet
Summary: RFE: S3 v2 RESTBucketGet
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 3.1
Hardware: Unspecified
OS: Unspecified
high
medium
Target Milestone: rc
: 4.1
Assignee: Albin Antony
QA Contact: Tejas
Ranjini M N
URL:
Whiteboard:
: 1784197 (view as bug list)
Depends On:
Blocks: 1816167
TreeView+ depends on / blocked
 
Reported: 2018-10-16 16:32 UTC by Kyle Bader
Modified: 2024-10-01 16:11 UTC (History)
15 users (show)

Fixed In Version: ceph-14.2.8-3.el8, ceph-14.2.8-3.el7
Doc Type: Enhancement
Doc Text:
.AWS S3 ListObjects v2 operation provides an improved mechanism to list the objects in the S3 bucket without additional configuration Previously, S3 protocol clients, like S3A and the awscli command-line tool, had to be configured with the older ListObjects method. With this feature, AWS S3 ListObjects v2 operation is implemented, that provides an improved mechanism to list objects in an S3 bucket.
Clone Of:
Environment:
Last Closed: 2020-05-19 17:30:39 UTC
Embargoed:
hyelloji: needinfo-


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHSA-2020:2231 0 None None None 2020-05-19 17:30:58 UTC

Description Kyle Bader 2018-10-16 16:32:35 UTC
Description of problem:

The S3A filesystem client from Hadoop common switched from the v1 list objects API to to v2 with Hadoop 3.0. This change has been backported to downstream Hortonworks, and since Cloudera 6 is based on Hadoop 3.0, it's present there as well. We do not currently support the v2 list objects API call, and given that it's now the default behavior for S3A, we probably should.

Currently, there is a workaround detailed in HADOOP-13421, which is setting a S3A property:

fs.s3a.list.version="1"


Additional info:

https://docs.aws.amazon.com/AmazonS3/latest/API/v2-RESTBucketGET.html
https://issues.apache.org/jira/browse/HADOOP-13421

Comment 4 Giridhar Ramaraju 2019-08-05 13:08:30 UTC
Updating the QA Contact to a Hemant. Hemant will be rerouting them to the appropriate QE Associate. 

Regards,
Giri

Comment 5 Giridhar Ramaraju 2019-08-05 13:09:57 UTC
Updating the QA Contact to a Hemant. Hemant will be rerouting them to the appropriate QE Associate. 

Regards,
Giri

Comment 9 Matt Benjamin (redhat) 2020-02-20 16:41:53 UTC
*** Bug 1784197 has been marked as a duplicate of this bug. ***

Comment 18 Albin Antony 2020-04-28 10:23:09 UTC
Hi Ranjini,

This looks fine.

Thanks

Comment 20 errata-xmlrpc 2020-05-19 17:30:39 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2020:2231


Note You need to log in before you can comment on or make changes to this bug.