Created attachment 1028265 [details] sfs_rc file for SPECsfs2014 benchmark Description of problem: The SPECsfs2014 benchmark, VDA workload fails when running on clients that are nfsv4 mounting Ganesha-gluster exported volumes. When clients are mounting kNFS or ganesha-vfs exported FS, the benchmark runs fine. Benchmark also runs fine when clients fuse mount gluster volume (same one that was being ganesha-gluster exported). Version-Release number of selected component (if applicable): glusterfs-libs-3.7.0-1.el7.x86_64 glusterfs-api-3.7.0-1.el7.x86_64 glusterfs-3.7.0-1.el7.x86_64 glusterfs-fuse-3.7.0-1.el7.x86_64 glusterfs-cli-3.7.0-1.el7.x86_64 nfs-ganesha-gluster-2.2.0-0.el7.centos.x86_64 glusterfs-client-xlators-3.7.0-1.el7.x86_64 glusterfs-server-3.7.0-1.el7.x86_64 glusterfs-ganesha-3.7.0-1.el7.x86_64 nfs-ganesha-vfs-2.2.0-0.el7.centos.x86_64 nfs-ganesha-2.2.0-0.el7.centos.x86_64 kernel-3.10.0-229.el7.x86_64 (RHEL 7.1) How reproducible: 2 times out of 2 runs Steps to Reproduce: 1. single-brick, single-server gluster volume, exported with ganesha-gluster. nfsv4 mount on clients used in testing. install specsfs2014 on clients as per user guide instructions. 2. Run the SPECsfs2014 benchmark with the attached sfs_rc file, as follows (this rc file is for 6 clients): python SfsManager -r sfs_rc -s ${RUN_TAG} 3. Monitor benchmark progress in results/sfslog_${RUN_TAG}. At higher loads, benchmark will typically error out when running on ganesha-gluster. Actual results: Benchmark error with following message: Client testing failed: <date> netmist did not complete successfully. The netmist return code was: 101 Expected results: Benchmark completes successfully. Additional info:
Created attachment 1028269 [details] ganesha conf file used
team-nfs
I am not working on this at the moment, moving back to NEW. Manoj, could you check if a newer version of RHGS (updated NFS-Ganesha and Gluster) happens to fix this problem?
I am hoping to find some time soon to get to this. Don't have an ETA yet.
(In reply to Shekhar Berry from comment #9) > The test was repeated with RHGS 3.2 and it ran successfully for VDA workload > of SPECsfs2014. > > Version: > > glusterfs-libs-3.8.4-18.el7rhgs.x86_64 > glusterfs-3.8.4-18.el7rhgs.x86_64 > glusterfs-api-3.8.4-18.el7rhgs.x86_64 > glusterfs-fuse-3.8.4-18.el7rhgs.x86_64 > glusterfs-server-3.8.4-18.el7rhgs.x86_64 > glusterfs-client-xlators-3.8.4-18.el7rhgs.x86_64 > glusterfs-cli-3.8.4-18.el7rhgs.x86_64 > nfs-ganesha-gluster-2.4.1-9.el7rhgs.x86_64 > glusterfs-ganesha-3.8.4-18.el7rhgs.x86_64 > > > The same sfs_rc which is given in BZ description above was used for this > test as well. Thanks, Shekhar!