Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use https://ibm-ceph.atlassian.net/ for all bug tracking management.

Bug 2362848

Summary: [rgw][7.1][s3-select]: rgw crashing while executing query "select ( not ( -29988263083828 / utcnow() ) ) from s3object;" on a parquet object
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Hemanth Sai <hmaheswa>
Component: RGWAssignee: Matt Benjamin (redhat) <mbenjamin>
Status: CLOSED ERRATA QA Contact: Hemanth Sai <hmaheswa>
Severity: high Docs Contact: Rivka Pollack <rpollack>
Priority: unspecified    
Version: 7.1CC: bkunal, ceph-eng-bugs, cephqe-warriors, rpollack, tserlin
Target Milestone: ---Keywords: Automation
Target Release: 7.1z8   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ceph-18.2.1-346.el9cp Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2025-09-30 15:03:46 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Hemanth Sai 2025-04-29 06:20:42 UTC 
Description of problem:
rgw crashing while executing query "select ( not ( -29988263083828 / utcnow() ) ) from s3object;" on a parquet object


log snippet:

[cephuser@ceph-hsm-7-1-joo4id-node6 ~]$ time aws s3api --endpoint-url http://10.0.65.10:80 --profile elmay.88 select-object-content  --bucket elmay.88-bucky-1904-0 --key Key_elmay.88-bucky-1904-0_parquet --expression-type 'SQL' --input-serialization '{"Parquet": {}, "CompressionType": "NONE"}' --output-serialization '{"CSV": {}}' --expression "select ( not ( -29988263083828 / utcnow() ) ) from s3object;" /dev/stdout

("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read))

real	0m7.572s
user	0m0.500s
sys	0m0.109s




parquet object content:

[cephuser@ceph-hsm-7-1-joo4id-node6 ~]$ time aws s3api --endpoint-url http://10.0.65.10:80 --profile elmay.88 select-object-content  --bucket elmay.88-bucky-1904-0 --key Key_elmay.88-bucky-1904-0_parquet --expression-type 'SQL' --input-serialization '{"Parquet": {}, "CompressionType": "NONE"}' --output-serialization '{"CSV": {}}' --expression "select * from s3object;" /dev/stdout
109288386582,214166372401324.16,xbxzWtH8lh1K9OWg8fVT,2028-01-24T04:20:37.159225+00:00
48626624608,188874301292501.56,iK24fO9ktZ61r1lHPNna,2028-01-24T04:20:37.159268+00:00
109244947287,209435047600448.5,NHao1x6S8AwaG0X2VjS9,2028-01-24T04:20:37.159275+00:00
19480597341,157526865842490.62,rI9zDQSPRu9mBT0gguQf,2028-01-24T04:20:37.159280+00:00
7501899269,114201612155824.44,NVg05KAVo2soddL3Qi 7,2028-01-24T04:20:37.159285+00:00
15588004655,130273583485413.41,ci5XixgQDpppPTH mJS4,2028-01-24T04:20:37.159290+00:00
61215858246,162794993156897.5,OZXJdxOyzryNwcaz14DI,2028-01-24T04:20:37.159307+00:00
88162823289,181102131878132.91,UZA3qutKt67CNiO 7z38,2028-01-24T04:20:37.159313+00:00
15272681437,126612089864828.31,pIa jc0uGG2Z3CvUw5ns,2028-01-24T04:20:37.159318+00:00
73077476448,198145639676553.62,zRn3gD6pQ960qIsBqdHU,2028-01-24T04:20:37.159323+00:00
2034251351,127963531178051.09,HqiOLoGl1wL75xbz1J C,2028-01-24T04:20:37.159328+00:00
15875682811,172720023907046.25,pAw7MuejKPhZfWLvmt3D,2028-01-24T04:20:37.159332+00:00
97375235917,124294982133974,KpYegWWt3lgs6qiOZjPw,2028-01-24T04:20:37.159337+00:00
100731011911,182221724030817.56,m4UbOEzPHemStayLQjnW,2028-01-24T04:20:37.159342+00:00
110551273091,220197214443228.12,e19TsH0pdR2S6jPkAIhP,2028-01-24T04:20:37.159346+00:00
85026935769,130954946711938,0fVn218yyqurHt goJ2r,2028-01-24T04:20:37.159351+00:00
44739563063,114669439755740.72, gjxW6hjCLoRhaSr5dRw,2028-01-24T04:20:37.159356+00:00
32531374478,208996192806012.94,6fLS6lddur6LjbMc1ntE,2028-01-24T04:20:37.159360+00:00
6981856598,181279753565138.5,BmRrlg  9qIeZJu 0OmD,2028-01-24T04:20:37.159365+00:00
40266188210,204328155937304.69,djMKuo8Dt0tGQMJUELwr,2028-01-24T04:20:37.159370+00:00
32695002632,148487400292892,qfZrhgyLGjBH2BpYOUDJ,2028-01-24T04:20:37.159374+00:00
93812457946,186552314965088.47,OAJEPJZd5e3gIghaTmAS,2028-01-24T04:20:37.159379+00:00
4898730855,143293511724073.44,VP dIVGfiFTTMNB2lgZ7,2028-01-24T04:20:37.159384+00:00
106730573530,170763636742741.53,ScuYvLWUNvmLvm8X7JMl,2028-01-24T04:20:37.159388+00:00
56934932879,128584882215908.25,FTsHvxn6lwtE9rqV30iD,2028-01-24T04:20:37.159393+00:00
76073995585,165162753856749.84,rqFvheFnu0G3SmGoMAF9,2028-01-24T04:20:37.159398+00:00
60134744260,215250958725769.28,euwl7vUC2jAokUpC1kk5,2028-01-24T04:20:37.159402+00:00
13279583831,187377149743601.44,4eoa5QF6brb1lxCXkTrY,2028-01-24T04:20:37.159407+00:00
4657107031,117022793805178.53,iZVFssSoQfrUCrdbfnmK,2028-01-24T04:20:37.159412+00:00
37366169319,158492743260789.78,ysbEp4Lmg1O1kz4nzr5M,2028-01-24T04:20:37.159416+00:00

real	0m0.944s
user	0m0.758s
sys	0m0.155s
[cephuser@ceph-hsm-7-1-joo4id-node6 ~]$ 






rgw crash snippet:

  -5> 2025-04-29T04:58:07.825+0000 7fea642e2640 20 req 5963036754420584625 0.006000058s s3:get_obj get_obj_state: rctx=0x556bdb80ef50 obj=elmay.88-bucky-1904-0:Key_elmay.88-bucky-1904-0_parquet state=0x556bdeb2ede8 s->prefetch_data=1
    -4> 2025-04-29T04:58:07.825+0000 7fea642e2640 10 S3select: part 1 it.length() = 4103
    -3> 2025-04-29T04:58:07.825+0000 7fea642e2640 10 S3select:append_in_callback = 4103
    -2> 2025-04-29T04:58:07.825+0000 7fea642e2640 10 S3select: buffer is complete 4 request range length:4
    -1> 2025-04-29T04:58:07.825+0000 7fea642e2640 10 S3select: done waiting, buffer is complete buffer-size:4
     0> 2025-04-29T04:58:07.831+0000 7fea642e2640 -1 *** Caught signal (Aborted) **
 in thread 7fea642e2640 thread_name:notif-worker0

 ceph version 18.2.1-327.el9cp (8231b23b5fc431238517dc3adc21a3b5a4a7ce71) reef (stable)
 1: /lib64/libc.so.6(+0x3e730) [0x7feab9980730]
 2: /lib64/libc.so.6(+0x8b52c) [0x7feab99cd52c]
 3: raise()
 4: abort()
 5: /usr/bin/radosgw(+0x326838) [0x556bd99be838]
 6: (s3selectEngine::push_projection::builder(s3selectEngine::s3select*, char const*, char const*) const+0xf7) [0x556bd9caa1a7]
 7: /usr/bin/radosgw(+0x656eff) [0x556bd9ceeeff]
 8: /usr/bin/radosgw(+0x65b575) [0x556bd9cf3575]
 9: /usr/bin/radosgw(+0x65b5ae) [0x556bd9cf35ae]
 10: /usr/bin/radosgw(+0x65728a) [0x556bd9cef28a]
 11: /usr/bin/radosgw(+0x65734c) [0x556bd9cef34c]
 12: /usr/bin/radosgw(+0x65b7be) [0x556bd9cf37be]
 13: /usr/bin/radosgw(+0x64ca16) [0x556bd9ce4a16]
 14: /usr/bin/radosgw(+0x622829) [0x556bd9cba829]
 15: (RGWSelectObj_ObjStore_S3::run_s3select_on_parquet(char const*)+0x408) [0x556bd9ccae68]
 16: (RGWSelectObj_ObjStore_S3::execute(optional_yield)+0x2da) [0x556bd9ccbe3a]
 17: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xa53) [0x556bd9b08353]
 18: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*, int*)+0x1002) [0x556bd9b0f1a2]
 19: /usr/bin/radosgw(+0xb9e4d1) [0x556bda2364d1]
 20: /usr/bin/radosgw(+0x386066) [0x556bd9a1e066]
 21: make_fcontext()
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.




Version-Release number of selected component (if applicable):
ceph version 18.2.1-327.el9cp

How reproducible:
always

Steps to Reproduce:
1.deploy rhcs 7.1z4 with rgw daemons
2.create a bucket and upload a parquet object
3.execute s3-select query on parquet object "select ( not ( -29988263083828 / utcnow() ) ) from s3object;"

Actual results:
rgw crashing while executing above query

Expected results:
expected rgw should not crash and fail with error for invalid queries


Additional info:

automation fail log: http://magna002.ceph.redhat.com/cephci-jenkins/results/openstack/RH/7.1/rhel-9/Weekly/18.2.1-327/rgw/68/tier-4-rgw/test_s3select_with_depth2_queries_on_parquet_objects_0.log

rgw logs at debug_level 20:
http://magna002.ceph.redhat.com/cephci-jenkins/hsm/s3select_7.1z4_utcnow_crash/ceph-client.rgw.rgw.all.ceph-hsm-7-1-joo4id-node5.axlzzb.log
Comment 10 errata-xmlrpc 2025-09-30 15:03:46 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 7.1 security and bug fix updates), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2025:17059