Bug 2182421

Summary:	Trino / Ceph integration requires changes in S3select engine and RGW
Product:	[Red Hat Storage] Red Hat Ceph Storage	Reporter:	gal salomon <gsalomon>
Component:	RGW	Assignee:	gal salomon <gsalomon>
Status:	CLOSED ERRATA	QA Contact:	Hemanth Sai <hmaheswa>
Severity:	medium	Docs Contact:
Priority:	unspecified
Version:	6.0	CC:	ceph-eng-bugs, cephqe-warriors, kdreyer, mbenjamin, rpollack, tserlin
Target Milestone:	---	Flags:	gsalomon: needinfo-
Target Release:	7.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	ceph-18.2.0-1	Doc Type:	No Doc Update
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2023-12-13 15:20:13 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description gal salomon 2023-03-28 15:16:13 UTC

Description of problem:

Trino gains efficiency upon issuing multiple requests per single Query. the return results by RGW should be aligned with Trino expectations (otherwise queries are rejected or results are not accurate).
upon aggregation statement (count) Trino pushes down a non aggregation statement, which retrieves an empty column. Trino issue parallel multiple s3select-requests, it seems that deviation in the result relates to the number of parallel requests.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 2 gal salomon 2023-08-17 08:46:04 UTC

the following PR's deal with Trino / CEPH integration, and resolve various issues related to that integration.

https://github.com/ceph/ceph/pull/49411
https://github.com/ceph/ceph/pull/50471
https://github.com/ceph/ceph/pull/52651

Comment 10 gal salomon 2023-11-08 13:48:18 UTC

the Trino/CEPH integration is a title for "many things"
the CSV flow is one integration point (out of several). 
meaning there are specific flows in RGW that handle the Trino/s3select/CSV integration (for one example ... splitting the object).

the JSON and Parquet are the other integration points.
and there could be more in the future.

Comment 13 errata-xmlrpc 2023-12-13 15:20:13 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 7.0 Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:7780