Description of problem:
=======================
after rename from multiple mount file is not listed on mount and not accessible from mount but present in backend

mount:-
[root@localhost new]# ls -l
total 0

backend:-
/rhs/brick1/m2/new:
total 0
-rw-r--r-- 2 root root 0 Oct 27 13:53 b

Version-Release number of selected component (if applicable):
=============================================================
3.4.0.69rhs-1.el6rhs.x86_64

How reproducible:
================
2/2

Steps to Reproduce:
===================
1. create, start and mount dist-rep volume. (4x2)
[root@localhost ~]# gluster v info
 
Volume Name: manhoos
Type: Distributed-Replicate
Volume ID: 45f9e60b-e6cd-43c9-ab2b-85f94ad01bed
Status: Started
Number of Bricks: 4 x 2 = 8
Transport-type: tcp
Bricks:
Brick1: 10.70.47.97:/rhs/brick1/m1
Brick2: 10.70.47.98:/rhs/brick1/m1
Brick3: 10.70.47.97:/rhs/brick1/m2
Brick4: 10.70.47.98:/rhs/brick1/m2
Brick5: 10.70.47.97:/rhs/brick1/m3
Brick6: 10.70.47.98:/rhs/brick1/m3
Brick7: 10.70.47.97:/rhs/brick1/m4
Brick8: 10.70.47.98:/rhs/brick1/m4

mount:-
10.70.47.97:/manhoos on /mnt/m1 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
10.70.47.97:/manhoos on /mnt/m2 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
10.70.47.97:/manhoos on /mnt/nfs type nfs (rw,addr=10.70.47.97)


2. create few files inside it

[root@localhost new]# ls -l
total 0
-rw-r--r-- 1 root root 0 Oct 27 12:43 a
-rw-r--r-- 1 root root 0 Oct 27 12:43 b
-rw-r--r-- 1 root root 0 Oct 27 12:43 c
-rw-r--r-- 1 root root 0 Oct 27 12:43 d


3. start renaming files from multiple mount
while true; do cd /mnt/m1/new; mv -f a b; mv -f c d; mv -f b a; mv -f d c; cd / ; done

4. break loop after some time and check files

a. file is not listed on mount

[root@localhost new]# ls -l
total 0

verify file on backend:-
[root@localhost new]# ls -l /rhs/brick1/*/new
/rhs/brick1/m1/new:
total 0

/rhs/brick1/m2/new:
total 0
-rw-r--r-- 2 root root 0 Oct 27 13:53 b

/rhs/brick1/m3/new:
total 0

/rhs/brick1/m4/new:
total 0


[root@localhost new]# ls -l /rhs/brick1/m*/new
/rhs/brick1/m1/new:
total 0

/rhs/brick1/m2/new:
total 0

/rhs/brick1/m3/new:
total 0

/rhs/brick1/m4/new:
total 0


b. file is not accessible from mount:-

[root@localhost new]# ls -l /mnt/nfs/new/b
ls: cannot access /mnt/nfs/new/b: No such file or directory

log snippet:-

[2014-10-27 18:00:31.483025] W [client-rpc-fops.c:2604:client3_3_lookup_cbk] 0-manhoos-client-0: remote operation failed: Success. Path: /new/b (00000000-0000-0000-0000-000000000000)
[2014-10-27 18:00:31.483414] W [client-rpc-fops.c:2604:client3_3_lookup_cbk] 0-manhoos-client-2: remote operation failed: Success. Path: /new/b (00000000-0000-0000-0000-000000000000)
[2014-10-27 18:00:31.487398] W [client-rpc-fops.c:2604:client3_3_lookup_cbk] 0-manhoos-client-0: remote operation failed: Success. Path: /new/b (00000000-0000-0000-0000-000000000000)
[2014-10-27 18:00:31.487647] W [client-rpc-fops.c:2604:client3_3_lookup_cbk] 0-manhoos-client-2: remote operation failed: Success. Path: /new/b (00000000-0000-0000-0000-000000000000)
[2014-10-27 18:00:31.495570] W [client-rpc-fops.c:2523:client3_3_opendir_cbk] 0-manhoos-client-0: remote operation failed: Invalid argument. Path: /new (c69e03a4-c58a-4fc7-9268-7d7ff0b6bf27)
[2014-10-27 18:00:31.495675] W [client-rpc-fops.c:2523:client3_3_opendir_cbk] 0-manhoos-client-2: remote operation failed: Invalid argument. Path: /new (c69e03a4-c58a-4fc7-9268-7d7ff0b6bf27)



Actual results:
===============
1. file is present on backend but not accessible from mount
2. even though all sub-volumes are up, file is present only on one brick (replica is not present)

Expected results:
==================
1. file should be accessible from mount
2. file should have its replica


Additional info:
================
[root@localhost /]# gluster v status
Status of volume: manhoos
Gluster process                                         Port    Online   Pid
------------------------------------------------------------------------------
Brick 10.70.47.97:/rhs/brick1/m1                        49152   Y
        5405
Brick 10.70.47.98:/rhs/brick1/m1                        49152   Y
        3768
Brick 10.70.47.97:/rhs/brick1/m2                        49153   Y
        20111
Brick 10.70.47.98:/rhs/brick1/m2                        49153   Y
        3779
Brick 10.70.47.97:/rhs/brick1/m3                        49154   Y
        5416
Brick 10.70.47.98:/rhs/brick1/m3                        49154   Y
        3790
Brick 10.70.47.97:/rhs/brick1/m4                        49155   Y
        20133
Brick 10.70.47.98:/rhs/brick1/m4                        49155   Y
        3801
NFS Server on localhost                                 2049    Y
        9356
Self-heal Daemon on localhost                           N/A     Y
        9523
NFS Server on 10.70.47.97                               2049    Y
        5428
Self-heal Daemon on 10.70.47.97                         N/A     Y
        5435
 
Task Status of Volume manhoos
------------------------------------------------------------------------------
There are no active volume tasks