Bug 1475699 - [RFE]nfs-ganesha: Read directory contents in chunks
Summary: [RFE]nfs-ganesha: Read directory contents in chunks
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat Storage
Component: nfs-ganesha
Version: rhgs-3.2
Hardware: All
OS: All
unspecified
medium
Target Milestone: ---
: RHGS 3.5.0
Assignee: Frank Filz
QA Contact: Manisha Saini
URL:
Whiteboard:
Depends On: 1472942 1730686 1732671
Blocks: 1382343 1403648 1403757 1415608 1695078 1696803
TreeView+ depends on / blocked
 
Reported: 2017-07-27 07:59 UTC by Soumya Koduri
Modified: 2021-06-10 12:41 UTC (History)
15 users (show)

Fixed In Version: nfs-ganesha-2.7.3-3
Doc Type: Enhancement
Doc Text:
Directory contents are now read in configurable chunks so that very large directory listings can start to be served faster, instead of needing to wait for the whole directory to be read before serving to clients.
Clone Of:
: 1695078 (view as bug list)
Environment:
Last Closed: 2019-10-30 12:15:39 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 1472942 0 high CLOSED RHGS-3.4, rebase nfs-ganesha to 2.5.5 2021-02-22 00:41:40 UTC
Red Hat Product Errata RHEA-2019:3252 0 None None None 2019-10-30 12:16:15 UTC

Internal Links: 1472942

Description Soumya Koduri 2017-07-27 07:59:30 UTC
Description of problem:

The limitation with  <=nfs-ganesha 2.4.x is that ganesha process reads entire directory contents at one go before it starts serving to clients. This results in high latency for directory listing., esp., in case of large directories containing millions of entries, the listing may take few hours to complete making it look like hang.

This problem is addressed in 2.5 upstream release with the introduction of readdir-chunk feature. Now the ganesha service shall read directory contents in chunks (chunk size is configurable) and start serving clients sooner thus improving the user experience.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 6 Ambarish 2018-04-03 09:32:24 UTC
The very basic use case - creates and ls passes on an arbitrated volume.

I did not see any hangs , even after 48 hours of I/O and readdirs from v3/v4.0.

I am moving the RFE to Verified.

Full fledged testing of the feature will be done in Feature Testing/Regression phase.

Comment 8 Daniel Gryniewicz 2018-08-27 12:25:04 UTC
This should be moved out of 3.4, since dirent chunk is removed.

Comment 13 Bipin Kunal 2018-08-31 05:05:11 UTC
Hi Rejy/Atin/Ganesha team,

  I am still not convinced or maybe I am confused. The bug was already in the verified state. What did we verify then? 

  What all issue we see with the current fix? I don't see any bug relevant bug which is blocking this feature? Looks like things are missing on the bug.

  Why is doc team working on doc text?

  Can we capture all the details which justify a verified bug being moved out of release?

-Bipin Kunal

Comment 15 Rejy M Cyriac 2018-08-31 09:21:07 UTC
(In reply to Bipin Kunal from comment #13)
> Hi Rejy/Atin/Ganesha team,
> 
>   I am still not convinced or maybe I am confused. The bug was already in
> the verified state. What did we verify then? 
> 

This is an RFE BZ.

The move to VERIFIED at this BZ was based on the QE validation of the associated feature being available in a testable form at the Feature Freeze builds, which is a requirement for Feature Freeze criteria
Refer to Comment 6

>   What all issue we see with the current fix? I don't see any bug relevant
> bug which is blocking this feature? Looks like things are missing on the bug.
> 

I will defer to the nfs-ganesha team on this

>   Why is doc team working on doc text?
> 

I have now asked them not to.

>   Can we capture all the details which justify a verified bug being moved
> out of release?
> 
> -Bipin Kunal

Comment 23 Frank Filz 2019-10-16 19:50:27 UTC
Doc text looks good.

Comment 25 errata-xmlrpc 2019-10-30 12:15:39 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2019:3252


Note You need to log in before you can comment on or make changes to this bug.