Bug 1657715

Summary: socket: too many files open while trying to run volume list using heketi-cli
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: RamaKasturi <knarra>
Component: heketiAssignee: John Mulligan <jmulligan>
Status: CLOSED DUPLICATE QA Contact: Prasanth <pprakash>
Severity: medium Docs Contact:
Priority: unspecified    
Version: cns-3.10CC: arukumar, hchiramm, jmulligan, kramdoss, madam, nigoyal, pkundra, rhs-bugs, sankarshan, storage-qa-internal, vamahaja
Target Milestone: ---Keywords: ZStream
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-05-21 12:14:40 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description RamaKasturi 2018-12-10 10:37:53 UTC
Description of problem:
When running the command heketi-cli volume list it outputs 1019 volumes and after that it throws the error below.

[ec2-user@ip-172-16-29-85 ~]$ heketi-cli volume list | wc -l
Error: Get http://172.30.107.251:8080/volumes/aa6bac009257c73a671939e913628d5d: dial tcp 172.30.107.251:8080: socket: too many open files
1019



Version-Release number of selected component (if applicable):
[ec2-user@ip-172-16-29-85 ~]$ rpm -qa | grep heketi
heketi-client-7.0.0-11.el7rhgs.x86_64
sh-4.2# rpm -qa | grep heketi
heketi-7.0.0-11.1.HOTFIX.Case02251916.BZ1650138.el7rhgs.x86_64
heketi-client-7.0.0-11.1.HOTFIX.Case02251916.BZ1650138.el7rhgs.x86_64


How reproducible:
Always

Steps to Reproduce:
1. Create more than 1400+ volumes 
2. Now try running 'heketi volume list'
3.

Actual results:
Heketi lists 1019 volumes and after that the following error is seen.

[ec2-user@ip-172-16-29-85 ~]$ heketi-cli volume list | wc -l
Error: Get http://172.30.107.251:8080/volumes/aa6bac009257c73a671939e913628d5d: dial tcp 172.30.107.251:8080: socket: too many open files
1019


Expected results:
heketi cli should not throw any error.

Additional info:

when heketi-cli command is run from inside the pod, no such error is seen.

sh-4.2# heketi-cli volume list | wc -l
1544

The output of heketi-cli volume list is present in the volume list here.

http://rhsqe-repo.lab.eng.blr.redhat.com/cns/experian/AWS1_setup_glusterd_logs/heketi_cli_volume_list

Comment 2 Raghavendra Talur 2019-01-24 21:00:41 UTC
*** Bug 1658068 has been marked as a duplicate of this bug. ***

Comment 9 Yaniv Kaul 2019-05-02 09:46:54 UTC
Is anyone looking at this?

Comment 10 John Mulligan 2019-05-21 12:14:40 UTC

*** This bug has been marked as a duplicate of bug 1685127 ***