Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use https://ibm-ceph.atlassian.net/ for all bug tracking management.

Bug 2232338

Summary: SPDK reactor_0 process is killed due to Out of Memory and GW crashes
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Rahul Lepakshi <rlepaksh>
Component: NVMeOFAssignee: Aviv Caro <acaro>
Status: VERIFIED --- QA Contact: Rahul Lepakshi <rlepaksh>
Severity: urgent Docs Contact: ceph-doc-bot <ceph-doc-bugzilla>
Priority: unspecified    
Version: 7.0CC: cephqe-warriors, jcaratza
Target Milestone: ---Keywords: External
Target Release: 7.1   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: ceph-18.2.1-114 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Rahul Lepakshi 2023-08-16 11:39:23 UTC 
Description of problem:
Tracks https://github.com/ceph/ceph-nvmeof/issues/187
http://pastebin.test.redhat.com/1107520


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1. Deploy NVMeOF GW(RPM based) on OSD node 
2. Scale upto 1 subsystem and ~115 namespaces
3. RUN IO and leave the test setup idle, issue is hit after an hour or so
4. Actually issue was hit during test while adding namespaces too 

Actual results:
Out of memory: Killed process 182282 (reactor_0)

Expected results: Need insights on minimum memory recommendations as per scale and OSD collocated config


Additional info:
Comment 1 Aviv Caro 2024-04-02 18:47:15 UTC 
https://gitlab.cee.redhat.com/ceph/ceph/-/merge_requests/527
Comment 3 Rahul Lepakshi 2024-04-29 06:12:23 UTC 
This BZ will be closed as soon as https://jsw.ibm.com/browse/ISCE-845 is closed
Comment 4 Rahul Lepakshi 2024-05-08 04:56:14 UTC 
Issue is resolved in recent build.
ceph version 18.2.1-167.el9cp (e8c836edb24adb7717a6c8ba1e93a07e3efede29) reef (stable)
cp.stg.icr.io/cp/ibm-ceph/nvmeof-rhel9:1.2.6-1