Bug 1028984

Summary: DHT + NFS mount : got I/O error on lookup for non privileged user (all subvolumes were up and on FUSE mount it gave output)
Product: Red Hat Gluster Storage Reporter: Rachana Patel <racpatel>
Component: distributeAssignee: Nithya Balachandran <nbalacha>
Status: CLOSED DEFERRED QA Contact: storage-qa-internal <storage-qa-internal>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 2.1CC: mzywusko, spalai, vbellur
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
: 1286202 (view as bug list) Environment:
Last Closed: 2015-11-27 12:27:25 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Bug Depends On:    
Bug Blocks: 1286202    

Description Rachana Patel 2013-11-11 12:19:21 UTC 
Description of problem:
Distributed volume  was mounted using FUSE and NFS. While accessing data as a non privileged user got 'Input/output error' on NFS mount and on FUSE mount got output

all sub-volumes were up.

unable to reproduce it and don't know exact steps to reproduce

Version-Release number of selected component (if applicable):
3.4.0.42rhs-1.el6_4.x86_64

How reproducible:
not always

Steps to Reproduce: 
don't know exact steps.

1.
[u2@rhs-client22 d1]$ ls
ls: cannot open directory .: Input/output error
[u2@rhs-client22 d1]$ cd ..
bash: cd: ..: Input/output error


[root@rhs-client22 /]# df -h /mnt/dht-nfs
Filesystem            Size  Used Avail Use% Mounted on

df: `/mnt/dht-nfs': Input/output error


[root@7-VM3 brick4]# gluster v status dht
Status of volume: dht
Gluster process						Port	Online	Pid
------------------------------------------------------------------------------
Brick 10.70.36.132:/rhs/brick4/d1			49155	Y	8479
Brick 10.70.36.132:/rhs/brick4/d2			49156	Y	8490
Brick 10.70.36.132:/rhs/brick4/d3			49157	Y	8501
Brick 10.70.36.132:/rhs/brick4/d4			49158	Y	8512
NFS Server on localhost					2049	Y	8525
NFS Server on 10.70.36.131				2049	Y	6970
NFS Server on 10.70.36.133				2049	Y	14933
NFS Server on 10.70.36.130				2049	Y	9764


log snippet:-

[root@7-VM3 brick4]# tail -f /var/log/glusterfs/nfs.log
[2013-11-11 07:25:09.393889] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-0: remote operation failed: Permission denied. Path: /d96
[2013-11-11 07:25:09.393917] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 74aab523: /d96 => -1 (Permission denied)
[2013-11-11 07:25:09.395192] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-1: remote operation failed: Permission denied. Path: /d97
[2013-11-11 07:25:09.395219] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 75aab523: /d97 => -1 (Permission denied)
[2013-11-11 07:25:09.396849] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-2: remote operation failed: Permission denied. Path: /d98
[2013-11-11 07:25:09.396882] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 76aab523: /d98 => -1 (Permission denied)
[2013-11-11 07:25:09.398549] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-2: remote operation failed: Permission denied. Path: /d99
[2013-11-11 07:25:09.398579] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 77aab523: /d99 => -1 (Permission denied)
[2013-11-11 07:25:09.400300] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-dht-client-1: remote operation failed: Permission denied. Path: /d100
[2013-11-11 07:25:09.400332] W [nfs3.c:2731:nfs3svc_mkdir_cbk] 0-nfs: 78aab523: /d100 => -1 (Permission denied)

Actual results:
got I/O error on NFS mount

Expected results:
when all sub-volumes are up, it should not give I/O error on lookup

Additional info: