Bug 1020673

Description of problem:
If you enable cluster.nufa first and then quota, unable to write under directory for which quota limit is set and workaround is disable quota(disabling nufa doesn't make difference in error)

while running cluster.nufa test plan on DHT volume (FUSE mount), found that when quota is enabled sometimes I am unable to write to existing files and unable to create new files/Directory. It fails with 'Invalid argument' or 'No such...'

Tried few possible sequence to narrow down cases and reproduce it with exact steps and findings are
for DHT volume mounted using FUSE

1. unable to create new entry or write in existing file :-

- enable cluster.nufa. 
- Now enable quota and set limit for '/' (or create data and set limit for any dir,) and try to create new file/Directory or modify existing files under quota enabled directory. It will fail. 
e.g.
[root@rhs-client22 rpm]# mkdir  /mnt/test_nufa2/new/dcreate
mkdir: cannot create directory `/mnt/test_nufa2/new/dcreate': Invalid argument
[root@rhs-client22 rpm]# touch /mnt/test_nufa2/new/can1
touch: setting times of `/mnt/test_nufa2/new/can1': No such file or directory
- creation of files and directory under other directories(quota limit is not set) is completed successfully
- now disable quota on volume and error is gone
- If you do not disable quota but make cluster.nufa off then you will face same error on write

2. No error:-
- enable quota on volume and set limit for Directory.
- create some data and then set cluster.nufa on or set it on and then create data(both has same result)
- enable cluster.nufa. 
- try to write or create new entries and no error



Version-Release number of selected component (if applicable):
Big bend RHS ISO 
+ glusterfs-*-3.4.0.35rhs-1.el6rhs.x86_64


How reproducible:
always

Steps to Reproduce:
1.create a DHT volume and enable cluster.nufa
# gluster volume create test_nufa1 10.70.37.204:/rhs/brick1/b1 10.70.37.142:/rhs/brick1/b1
# gluster volume start test_nufa1
# gluster volume start test_nufa1

2.mount this volume using FUSE
[root@rhs-client22 rpm]# mount | grep test_nufa1
10.70.37.204:/test_nufa1 on /mnt/test_nufa1 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)

3. enable quota and set limit for directory
# gluster volume quota test_nufa1 enable
# gluster volume quota test_nufa1 limit-usage / 50MB 50%

4. create dir and files under from mount point

[root@rhs-client22 rpm]# touch /mnt/test_nufa1/f11
touch: setting times of `/mnt/test_nufa1/f11': No such file or directory
[root@rhs-client22 rpm]# mkdir /mnt/test_nufa1/new
mkdir: cannot create directory `/mnt/test_nufa1/new': Invalid argument


Actual results:
write is failing and getting error for quota and nufa enabled directory

Expected results:
write should not fail if quota limit is not exceeded

Additional info: