Describe the issue:

While doing rebalance after add-brick on a 4X3 volume with heterogenous replica sets, the below error may appear in rebalance.log 

E [MSGID: 114031] [client-rpc-fops_v2.c:150:client4_0_mknod_cbk] 0-dist_repl_c-client-9: remote operation failed. Path: /zile250 [No data available]


Provide version-Release number of selected component (if applicable):
RHGS build info : 6.0-57
 
Is this issue reproducible? sometimes 


Steps to Reproduce:
1. Create a 3X3 (all replica sets have 20G bricks) volume and start it.
2. Mount the volume using FUSE.
3. Perform following IO on the mount point (on volume root):
# for i in {1..500}; do dd if=/dev/urandom of=file$i bs=100K count=1; chmod 755 file$i; ln file$i hfile$i; setfattr -n user.test -v "foobar" file$i; chmod +t file$i; chmod +s file$i; mv -vf file$i zile$i; done
4. Add-brick to the volume (a replica set with 50G bricks).
5. Triggered rebalance

 
Actual results:
Failures in  brick / rebalance logs
Brick:
# grep zile250 bricks-brick1-brick9.log
W [MSGID: 113096] [posix-handle.c:795:posix_handle_hard] 0-dist_repl_c-posix: mismatching ino/dev between file /bricks/brick1/brick9/zile250 (214/64787) and handle /bricks/brick1/brick9/.glusterfs/dc/90/dc904fe5-1ebf-40c3-88a6-21f0a598fb9f (213/64787)
E [MSGID: 113020] [posix-entry-ops.c:554:posix_mknod] 0-dist_repl_c-posix: setting gfid on /bricks/brick1/brick9/zile250 failed [No data available]

Rebalance:
E [MSGID: 114031] [client-rpc-fops_v2.c:150:client4_0_mknod_cbk] 0-dist_repl_c-client-9: remote operation failed. Path: /zile250 [No data available]

Expected results:
----------------
There should not be ERROR in rebalance log.