Bug 1475699

Summary: [RFE]nfs-ganesha: Read directory contents in chunks
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Soumya Koduri <skoduri>
Component: nfs-ganeshaAssignee: Frank Filz <ffilz>
Status: CLOSED ERRATA QA Contact: Manisha Saini <msaini>
Severity: medium Docs Contact:
Priority: unspecified    
Version: rhgs-3.2CC: amukherj, asriram, bkunal, dang, ffilz, jthottan, kkeithle, pasik, psony, rcyriac, rhinduja, rhs-bugs, sanandpa, sheggodu, storage-qa-internal
Target Milestone: ---Keywords: FutureFeature
Target Release: RHGS 3.5.0   
Hardware: All   
OS: All   
Whiteboard:
Fixed In Version: nfs-ganesha-2.7.3-3 Doc Type: Enhancement
Doc Text:
Directory contents are now read in configurable chunks so that very large directory listings can start to be served faster, instead of needing to wait for the whole directory to be read before serving to clients.
Story Points: ---
Clone Of:
: 1695078 (view as bug list) Environment:
Last Closed: 2019-10-30 12:15:39 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1472942, 1730686, 1732671    
Bug Blocks: 1382343, 1403648, 1403757, 1415608, 1695078, 1696803    

Description Soumya Koduri 2017-07-27 07:59:30 UTC
Description of problem:

The limitation with  <=nfs-ganesha 2.4.x is that ganesha process reads entire directory contents at one go before it starts serving to clients. This results in high latency for directory listing., esp., in case of large directories containing millions of entries, the listing may take few hours to complete making it look like hang.

This problem is addressed in 2.5 upstream release with the introduction of readdir-chunk feature. Now the ganesha service shall read directory contents in chunks (chunk size is configurable) and start serving clients sooner thus improving the user experience.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 6 Ambarish 2018-04-03 09:32:24 UTC
The very basic use case - creates and ls passes on an arbitrated volume.

I did not see any hangs , even after 48 hours of I/O and readdirs from v3/v4.0.

I am moving the RFE to Verified.

Full fledged testing of the feature will be done in Feature Testing/Regression phase.

Comment 8 Daniel Gryniewicz 2018-08-27 12:25:04 UTC
This should be moved out of 3.4, since dirent chunk is removed.

Comment 13 Bipin Kunal 2018-08-31 05:05:11 UTC
Hi Rejy/Atin/Ganesha team,

  I am still not convinced or maybe I am confused. The bug was already in the verified state. What did we verify then? 

  What all issue we see with the current fix? I don't see any bug relevant bug which is blocking this feature? Looks like things are missing on the bug.

  Why is doc team working on doc text?

  Can we capture all the details which justify a verified bug being moved out of release?

-Bipin Kunal

Comment 15 Rejy M Cyriac 2018-08-31 09:21:07 UTC
(In reply to Bipin Kunal from comment #13)
> Hi Rejy/Atin/Ganesha team,
> 
>   I am still not convinced or maybe I am confused. The bug was already in
> the verified state. What did we verify then? 
> 

This is an RFE BZ.

The move to VERIFIED at this BZ was based on the QE validation of the associated feature being available in a testable form at the Feature Freeze builds, which is a requirement for Feature Freeze criteria
Refer to Comment 6

>   What all issue we see with the current fix? I don't see any bug relevant
> bug which is blocking this feature? Looks like things are missing on the bug.
> 

I will defer to the nfs-ganesha team on this

>   Why is doc team working on doc text?
> 

I have now asked them not to.

>   Can we capture all the details which justify a verified bug being moved
> out of release?
> 
> -Bipin Kunal

Comment 23 Frank Filz 2019-10-16 19:50:27 UTC
Doc text looks good.

Comment 25 errata-xmlrpc 2019-10-30 12:15:39 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2019:3252