Bug 2365146 - [rgw][s3select]: radosgw process killed with "Out of memory" while executing query "select * from s3object limit 1" on a 12GB parquet file
Summary: [rgw][s3select]: radosgw process killed with "Out of memory" while executing ...
Keywords:
Status: VERIFIED
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 8.1
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 8.1
Assignee: Matt Benjamin (redhat)
QA Contact: Yuva Teja Sree Gayam
Rivka Pollack
URL:
Whiteboard:
Depends On: 2252403
Blocks: 2351689 2275323
TreeView+ depends on / blocked
 
Reported: 2025-05-08 19:17 UTC by tserlin
Modified: 2025-05-27 15:32 UTC (History)
10 users (show)

Fixed In Version: ceph-19.2.1-184.el9cp
Doc Type: Bug Fix
Doc Text:
.Large queries on Parquet objects no longer emit an `Out of memory` error Previously, in some cases, when a query was processed on a Parquet object, that object was read in large chunks. This caused the Ceph Object Gateway to load a larger buffer into the memory, which was too big for low-end machines. The memory would especially be affected when Ceph Object Gateway was co-located with OSD processes, which consume a large amount of memory. With the `Out of memory` error, the OS killed the Ceph Object Gateway process. With this fix, the there is an updated limit for the reader-buffer size for reading column chunks. The default size is now 16 MB and the size can be changed through the Ceph Object Gateway configuration file.
Clone Of: 2252403
Environment:
Last Closed:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHCEPH-11365 0 None None None 2025-05-08 19:19:07 UTC

Description tserlin 2025-05-08 19:17:38 UTC
+++ This bug was initially created as a clone of Bug #2252403 +++


Note You need to log in before you can comment on or make changes to this bug.