Created attachment 1225712 [details]
Permission Denied

Description of problem:
Getting permission denied on migration of data warnigns on the server after rebalance . 

Version-Release number of selected component (if applicable):
[root@dhcp47-116 testmount]# rpm -qa | grep gluster
glusterfs-client-xlators-3.8.4-5.el7.x86_64
glusterfs-3.8.4-5.el7.x86_64
glusterfs-fuse-3.8.4-5.el7.x86_64
glusterfs-libs-3.8.4-5.el7.x86_64
[root@dhcp47-116 testmount]# 


How reproducible:
2/3
Logs are placed at rhsqe-repo.lab.eng.blr.redhat.com:/var/www/html/sosreports/<bug>

Steps to Reproduce:
1. Create a 1x(2+1) arbiter volume and mount it to a client
2. Create 1000 directories and 1000 files using mkdir dir{1..1000} and touch abc{1..1000}
3. Now replace a brick from server1 with a new brick on the same server.
4. let the heal be completed and now add 3 bricks to form a new subvolume in the same volume. 
5. After the adding of bricks is successful, now trigger rebalance ; gluster volume rebalance testvol start

Actual results:
W [MSGID: 114031] [client-rpc-fops.c:1893:client3_3_fsetxattr_cbk] 0-testvol-client-3: remote operation failed [Permission denied]
[2016-11-29 06:35:01.819231] W [MSGID: 114031] [client-rpc-fops.c:1893:client3_3_fsetxattr_cbk] 0-testvol-client-5: remote operation failed [Permission denied]
[2016-11-29 06:35:01.819293] W [MSGID: 114031] [client-rpc-fops.c:1893:client3_3_fsetxattr_cbk] 0-testvol-client-4: remote operation failed [Permission denied]
[2016-11-29 06:35:01.820177] W [MSGID: 109023] [dht-rebalance.c:693:__dht_rebalance_create_dst_file] 0-testvol-dht: /abc1664: failed to set xattr on testvol-replicate-1 (Permission denied)

Expected results:

There should be no errors/warnings during rebalance.


Additional info:
tested on RHEL 6.8