Description of problem: Distributed volume was mounted using FUSE and NFS. While accessing data as a non privileged user got 'Input/output error' on NFS mount and on FUSE mount got output all sub-volumes were up. unable to reproduce it and don't know exact steps to reproduce Version-Release number of selected component (if applicable): 3.4.0.42rhs-1.el6_4.x86_64 How reproducible: not always Steps to Reproduce: don't know exact steps. 1. [u2@rhs-client22 d1]$ ls ls: cannot open directory .: Input/output error [u2@rhs-client22 d1]$ cd .. bash: cd: ..: Input/output error [root@rhs-client22 /]# df -h /mnt/dht-nfs Filesystem Size Used Avail Use% Mounted on df: `/mnt/dht-nfs': Input/output error [root@7-VM3 brick4]# gluster v status dht Status of volume: dht Gluster process Port Online Pid ------------------------------------------------------------------------------ Brick 10.70.36.132:/rhs/brick4/d1 49155 Y 8479 Brick 10.70.36.132:/rhs/brick4/d2 49156 Y 8490 Brick 10.70.36.132:/rhs/brick4/d3 49157 Y 8501 Brick 10.70.36.132:/rhs/brick4/d4 49158 Y 8512 NFS Server on localhost 2049 Y 8525 NFS Server on 10.70.36.131 2049 Y 6970 NFS Server on 10.70.36.133 2049 Y 14933 NFS Server on 10.70.36.130 2049 Y 9764 log snippet:- [root@7-VM3 brick4]# tail -f /var/log/glusterfs/nfs.log [2013-11-11 07:25:09.393889] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-0: remote operation failed: Permission denied. Path: /d96 [2013-11-11 07:25:09.393917] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 74aab523: /d96 => -1 (Permission denied) [2013-11-11 07:25:09.395192] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-1: remote operation failed: Permission denied. Path: /d97 [2013-11-11 07:25:09.395219] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 75aab523: /d97 => -1 (Permission denied) [2013-11-11 07:25:09.396849] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-2: remote operation failed: Permission denied. Path: /d98 [2013-11-11 07:25:09.396882] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 76aab523: /d98 => -1 (Permission denied) [2013-11-11 07:25:09.398549] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-2: remote operation failed: Permission denied. Path: /d99 [2013-11-11 07:25:09.398579] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 77aab523: /d99 => -1 (Permission denied) [2013-11-11 07:25:09.400300] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-1: remote operation failed: Permission denied. Path: /d100 [2013-11-11 07:25:09.400332] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 78aab523: /d100 => -1 (Permission denied) Actual results: got I/O error on NFS mount Expected results: when all sub-volumes are up, it should not give I/O error on lookup Additional info: