As per the code flow, this should not be happening. But, I see that 'fstat()' is returning lesser size than what is expected (as while debugging, we can see file sizes are same on the bricks). Shylesh, Is it possible to build glusterfs from source there?
1. Created a distribute volume 2. Added some files from mount point 3. added a new brick 4. Initiate reblance Bug ---- After rebalance number of files on mount point increased because of .*.gfs files on mount point. glusterd log shows that there is a difference in file sizes . ============================================================= [2011-10-11 01:52:12.614577] E [glusterd-rebalance.c:84:migrate_xattrs_of_file] 0-glusterfs: failed to set the xattr for key security.selinux (Operation not supported) [2011-10-11 01:52:12.614616] W [glusterd-rebalance.c:207:gf_glusterd_rebalance_move_data] 0-glusterfs: failed to copy the extended attributes from source file /etc/glusterd/mount/vol-dis/12 [2011-10-11 01:52:12.990545] E [glusterd-rebalance.c:84:migrate_xattrs_of_file] 0-glusterfs: failed to set the xattr for key security.selinux (Operation not supported) [2011-10-11 01:52:12.990596] W [glusterd-rebalance.c:207:gf_glusterd_rebalance_move_data] 0-glusterfs: failed to copy the extended attributes from source file /etc/glusterd/mount/vol-dis/14 [2011-10-11 01:52:13.204584] E [glusterd-rebalance.c:84:migrate_xattrs_of_file] 0-glusterfs: failed to set the xattr for key security.selinux (Operation not supported) [2011-10-11 01:52:13.204617] W [glusterd-rebalance.c:207:gf_glusterd_rebalance_move_data] 0-glusterfs: failed to copy the extended attributes from source file /etc/glusterd/mount/vol-dis/15 [2011-10-11 01:52:13.302086] E [glusterd-rebalance.c:84:migrate_xattrs_of_file] 0-glusterfs: failed to set the xattr for key security.selinux (Operation not supported) [2011-10-11 01:52:13.302114] W [glusterd-rebalance.c:207:gf_glusterd_rebalance_move_data] 0-glusterfs: failed to copy the extended attributes from source file /etc/glusterd/mount/vol-dis/16 [2011-10-11 01:52:13.318665] E [glusterd-rebalance.c:84:migrate_xattrs_of_file] 0-glusterfs: failed to set the xattr for key security.selinux (Operation not supported) [2011-10-11 01:52:13.318695] W [glusterd-rebalance.c:207:gf_glusterd_rebalance_move_data] 0-glusterfs: failed to copy the extended attributes from source file /etc/glusterd/mount/vol-dis/17 [2011-10-11 01:52:13.319286] W [glusterd-rebalance.c:251:gf_glusterd_rebalance_move_data] 0-glusterfs: file sizes are not same : /etc/glusterd/mount/vol-dis/17 ===========================================================================
Works fine with write-behind OFF
CHANGE: http://review.gluster.com/665 (stat returned in setattr_cbk can be cached by the kernel. Hence it is) merged in release-3.2 by Anand Avati (avati)
*** Bug 3812 has been marked as a duplicate of this bug. ***
Don't we need the fix in master branch?
(In reply to comment #5) > Don't we need the fix in master branch? http://review.gluster.com/#change,713 and http://review.gluster.com/#change,712 for master will fix this. For some reason, the bug-id in the patches was not updated.
Can we verify if this issue still exists?
CHANGE: http://review.gluster.com/3011 (performance/write-behind: queue setattr fop with writes always.) merged in master by Vijay Bellur (vijay)
Checked on release-3.3 branch. These messages are no longer present in the rebalance log files even with write-behind on.