Bug 1639817

Summary:	RFE: S3 v2 RESTBucketGet
Product:	[Red Hat Storage] Red Hat Ceph Storage	Reporter:	Kyle Bader <kbader>
Component:	RGW	Assignee:	Albin Antony <aantony>
Status:	CLOSED ERRATA	QA Contact:	Tejas <tchandra>
Severity:	medium	Docs Contact:	Ranjini M N <rmandyam>
Priority:	high
Version:	3.1	CC:	aantony, cbodley, ceph-eng-bugs, ceph-qe-bugs, hyelloji, kbader, knortema, mbenjamin, nagata3333333, pasik, rmandyam, sbaldwin, sweil, tserlin, uboppana
Target Milestone:	rc	Keywords:	FutureFeature
Target Release:	4.1	Flags:	hyelloji: needinfo-
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	ceph-14.2.8-3.el8, ceph-14.2.8-3.el7	Doc Type:	Enhancement
Doc Text:	.AWS S3 ListObjects v2 operation provides an improved mechanism to list the objects in the S3 bucket without additional configuration Previously, S3 protocol clients, like S3A and the awscli command-line tool, had to be configured with the older ListObjects method. With this feature, AWS S3 ListObjects v2 operation is implemented, that provides an improved mechanism to list objects in an S3 bucket.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2020-05-19 17:30:39 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1816167

Description Kyle Bader 2018-10-16 16:32:35 UTC

Description of problem:

The S3A filesystem client from Hadoop common switched from the v1 list objects API to to v2 with Hadoop 3.0. This change has been backported to downstream Hortonworks, and since Cloudera 6 is based on Hadoop 3.0, it's present there as well. We do not currently support the v2 list objects API call, and given that it's now the default behavior for S3A, we probably should.

Currently, there is a workaround detailed in HADOOP-13421, which is setting a S3A property:

fs.s3a.list.version="1"


Additional info:

https://docs.aws.amazon.com/AmazonS3/latest/API/v2-RESTBucketGET.html
https://issues.apache.org/jira/browse/HADOOP-13421

Comment 4 Giridhar Ramaraju 2019-08-05 13:08:30 UTC

Updating the QA Contact to a Hemant. Hemant will be rerouting them to the appropriate QE Associate. 

Regards,
Giri

Comment 5 Giridhar Ramaraju 2019-08-05 13:09:57 UTC

Updating the QA Contact to a Hemant. Hemant will be rerouting them to the appropriate QE Associate. 

Regards,
Giri

Comment 9 Matt Benjamin (redhat) 2020-02-20 16:41:53 UTC

*** Bug 1784197 has been marked as a duplicate of this bug. ***

Comment 18 Albin Antony 2020-04-28 10:23:09 UTC

Hi Ranjini,

This looks fine.

Thanks

Comment 20 errata-xmlrpc 2020-05-19 17:30:39 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2020:2231