Bug 2365146 - [rgw][s3select]: radosgw process killed with "Out of memory" while executing query "select * from s3object limit 1" on a 12GB parquet file
Summary: [rgw][s3select]: radosgw process killed with "Out of memory" while executing ...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RGW
Version: 8.1
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 8.1
Assignee: Matt Benjamin (redhat)
QA Contact: Yuva Teja Sree Gayam
Rivka Pollack
URL:
Whiteboard:
Depends On: 2252403
Blocks: 2275323 2351689
TreeView+ depends on / blocked
 
Reported: 2025-05-08 19:17 UTC by tserlin
Modified: 2025-06-26 12:31 UTC (History)
10 users (show)

Fixed In Version: ceph-19.2.1-184.el9cp
Doc Type: Bug Fix
Doc Text:
.Large queries on Parquet objects no longer emit an `Out of memory` error Previously, in some cases, when a query was processed on a Parquet object, that object was read in large chunks. This caused the Ceph Object Gateway to load a larger buffer into the memory, which was too big for low-end machines. The memory would especially be affected when Ceph Object Gateway was co-located with OSD processes, which consume a large amount of memory. With the `Out of memory` error, the OS killed the Ceph Object Gateway process. With this fix, the there is an updated limit for the reader-buffer size for reading column chunks. The default size is now 16 MB and the size can be changed through the Ceph Object Gateway configuration file.
Clone Of: 2252403
Environment:
Last Closed: 2025-06-26 12:31:39 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHCEPH-11365 0 None None None 2025-05-08 19:19:07 UTC
Red Hat Product Errata RHSA-2025:9775 0 None None None 2025-06-26 12:31:52 UTC

Description tserlin 2025-05-08 19:17:38 UTC
+++ This bug was initially created as a clone of Bug #2252403 +++

Comment 7 errata-xmlrpc 2025-06-26 12:31:39 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: Red Hat Ceph Storage 8.1 security, bug fix, and enhancement updates), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2025:9775


Note You need to log in before you can comment on or make changes to this bug.