Bug 1365459
| Summary: | [Perf] : Poor smallfile performance on Ganesha v4 mounts | ||
|---|---|---|---|
| Product: | [Community] GlusterFS | Reporter: | Ambarish <asoman> |
| Component: | ganesha-nfs | Assignee: | Soumya Koduri <skoduri> |
| Status: | CLOSED EOL | QA Contact: | Ambarish <asoman> |
| Severity: | high | Docs Contact: | |
| Priority: | urgent | ||
| Version: | 3.8 | CC: | amukherj, bbk, bugs, jthottan, kkeithle, mzywusko, ndevos |
| Target Milestone: | --- | Keywords: | Triaged |
| Target Release: | --- | ||
| Hardware: | x86_64 | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2017-11-07 10:36:18 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
I see a problem on smallfile renames on Ganesha v3 as well : On Ganesha v3 mounts : 156 files/sec On GlusterNFS : 367 files/sec The rest of the stuff looked comparable on v3 mounts. All 3.8.x bugs are now reported against version 3.8 (without .x). For more information, see http://www.gluster.org/pipermail/gluster-devel/2016-September/050859.html This bug is getting closed because the 3.8 version is marked End-Of-Life. There will be no further updates to this version. Please open a new bug against a version that still receives bugfixes if you are still facing this issue in a more current release. |
Created attachment 1189209 [details] Server Profiles Description of problem: ----------------------- Smallfile creates,reads,renames etc are slow on Ganesha v4 mounts : *On Ganesha v4* : Creates : 466 files/sec Reads : 639 files/sec Renames : 160 files/sec Rmdir : 726 files/sec Under the same workload,this is what I am seeing on Gluster NFS : Creates : 880 files/sec Reads : 2512 files/sec Renames : 367 files/sec Rmdir : 1017 files/sec Both these results are with "Smallfile Perf enhancements" - cluster.lookup-optimize is on and server.event-threads and client.event-threads are 4 each. Version-Release number of selected component (if applicable): ------------------------------------------------------------- glusterfs-server-3.8.1-0.4.git56fcf39.el7rhgs.x86_64 nfs-ganesha-gluster-2.4-0.dev.26.el7rhgs.x86_64 pacemaker-libs-1.1.13-10.el7.x86_64 pcs-0.9.143-15.el7.x86_64 How reproducible: ---------------- 100% Steps to Reproduce: ------------------- My setup consists of 4 servers and 4 clients.Each client mounts from 1 server. Run smallfile workload in a distributed-multithreaded way: python /small-files/smallfile/smallfile_cli.py --operation create --threads 8 --file-size 64 --files 10000 --top /gluster-mount --host-set "`echo $CLIENT | tr ' ' ','`" python /small-files/smallfile/smallfile_cli.py --operation read --threads 8 --file-size 64 --files 10000 --top /gluster-mount --host-set "`echo $CLIENT | tr ' ' ','`" etc. Actual results: --------------- Smallfile performance is slow Expected results: ----------------- Additional info: ---------------- Volume Name: testvol Type: Distributed-Replicate Volume ID: 3ee2c046-939b-4915-908b-859bfcad0840 Status: Started Number of Bricks: 2 x 2 = 4 Transport-type: tcp Bricks: Brick1: gqas001.sbu.lab.eng.bos.redhat.com:/bricks/testvol_brick0 Brick2: gqas014.sbu.lab.eng.bos.redhat.com:/bricks/testvol_brick1 Brick3: gqas015.sbu.lab.eng.bos.redhat.com:/bricks/testvol_brick2 Brick4: gqas016.sbu.lab.eng.bos.redhat.com:/bricks/testvol_brick3 Options Reconfigured: client.event-threads: 4 server.event-threads: 4 cluster.lookup-optimize: on ganesha.enable: on features.cache-invalidation: on nfs.disable: on performance.readdir-ahead: on performance.stat-prefetch: off server.allow-insecure: on nfs-ganesha: enable cluster.enable-shared-storage: enable