Bug 66525

Summary: too many files open in system
Product: [Retired] Red Hat Linux Reporter: Robert Reynolds <rreynol>
Component: kernelAssignee: Arjan van de Ven <arjanv>
Status: CLOSED CURRENTRELEASE QA Contact: Brian Brock <bbrock>
Severity: high Docs Contact:
Priority: high    
Version: 7.1   
Target Milestone: ---   
Target Release: ---   
Hardware: i686   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2004-09-30 15:39:40 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
log of /proc/sys/fs/file-nr every 5 minutes
none
lsof ps -elf and top just before server hang
none
output log of wc on open files, taken after server had been rebooted
none
ps output to match fd_list after server rebooted none

Description Robert Reynolds 2002-06-11 19:45:18 UTC 
From Bugzilla Helper:
User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; T312461)

Description of problem:
2.4.9-31enterprise running on Compaq DL360 2 cpu will hang after several days.  
Any command you attempt displays error "too many open files in system"

We are logging file-nr every 5 minutes and notice the number of allocated 
filehandles gradually increase until hits 8192, the system then hangs soon 
thereafter.

Have looked over bug #40071 that is similar but not quite the same.  This 
behavior is not happening on the test server we have running 2.4.9-31 (not 
enterprise) on a Compaq DL360 with one cpu.  Both servers are running the same 
application, albeit under different loads.

Attached is the filehandle log and lsof, ps and top output.

Version-Release number of selected component (if applicable):


How reproducible:
Always

Steps to Reproduce:
1.start up server
2.users logon
3.watch allocated filehandles rise until system hangs
	

Actual Results:  too many files open in system

Expected Results:  file handle allocation should not grow.  This is what we see 
on the test server.

Additional info:
Comment 1 Robert Reynolds 2002-06-11 19:54:17 UTC 
Created attachment 60568 [details]
log of /proc/sys/fs/file-nr every 5 minutes
Comment 2 Robert Reynolds 2002-06-11 19:55:45 UTC 
Created attachment 60569 [details]
lsof ps -elf and top just before server hang
Comment 3 Robert Reynolds 2002-06-11 19:57:03 UTC 
Created attachment 60570 [details]
output log of wc on open files,  taken after server had been rebooted
Comment 4 Robert Reynolds 2002-06-11 19:58:00 UTC 
Created attachment 60571 [details]
ps output to match fd_list after server rebooted
Comment 5 Robert Reynolds 2002-06-17 15:46:10 UTC 
Have rebooted server to use 2.4.9-31 in single cpu mode, not enterprise or smp
version of kernel.  Steady increase in filehandle allocations continues.  Value
of file-max increased from 8192 to 32768.

At this point we are working with the java developers to see how we can better
isolate the problem.
Comment 6 Bugzilla owner 2004-09-30 15:39:40 UTC 
Thanks for the bug report. However, Red Hat no longer maintains this version of
the product. Please upgrade to the latest version and open a new bug if the problem
persists.

The Fedora Legacy project (http://fedoralegacy.org/) maintains some older releases, 
and if you believe this bug is interesting to them, please report the problem in
the bug tracker at: http://bugzilla.fedora.us/