Bug 1016482

Description of problem:
When writing directories to a replicate volume, some directory owners become root.

Version-Release number of selected component (if applicable):
glusterfs-fuse-3.3.0-1.el6.x86_64
glusterfs-debuginfo-3.3.0-1.el6.x86_64
glusterfs-server-3.3.0-1.el6.x86_64
glusterfs-3.3.0-1.el6.x86_64

How reproducible:


Steps to Reproduce:
1. install the above gluster release
2. setup a new 3 replicated volume
3. write directory via NFS, user is "users"

Actual results:
Owners of some directories become "root".

[root@test01 volume]# ls -l 01/000/000/000/256
・
・
drwxr----- 2 users users 4096  Sep 28 09:31 534
drwxr----- 2 users users 4096  Sep 28 09:33 535
drwxr----- 2 users users 4096  Sep 28 09:36 536
drwxr----- 2 users users 4096  Sep 28 09:38 537
drwxr----- 2 root   root   4096  Sep 28 09:38 538
drwxr----- 2 users users 4096  Sep 28 09:44 539
drwxr----- 2 users users 4096  Sep 28 09:47 540
drwxr----- 2 users users 4096  Sep 28 09:49 541
drwxr----- 2 users users 4096  Sep 28 17:34 542


Looking　all the server logs (/var/log/glusterfs/bricks/mnt-volume.log), reveals "failed to set gfid" on target directory at the correct time:

[2013-09-28 09:38:38.945510] W [posix-handle.c:529:posix_handle_soft] 0-volume-posix: symlink ../../c0/7f/c07f1d0e-3504-40b6-a1b5-a308f3c4ffb2/538 -> /mnt/volume/.glusterfs/9a/51/9a51a2a9-83e2-48e3-9f1b-15ea1a8e67da failed (File exists)
[2013-09-28 09:38:38.956158] E [posix.c:968:posix_mkdir] 0-volume-posix: setting gfid on /mnt/volume/01/000/000/000/256/538 failed
[2013-09-28 09:38:39.011693] I [server3_1-fops.c:151:server_lookup_cbk] 0-volume-server: 421116617: LOOKUP /01/000/000/000/256/538/041 (00000000-0000-0000-0000-000000000000) ==> -1 (Permission denied)
[2013-09-28 09:38:39.019862] I [server3_1-fops.c:1623:server_create_cbk] 0-volume-server: 421116619: CREATE /01/000/000/000/256/538/041 (00000000-0000-0000-0000-000000000000) ==> -1 (Permission denied)
[2013-09-28 09:38:39.098092] I [server3_1-fops.c:298:server_finodelk_cbk] 0-volume-server: 421116622: FINODELK -2 (--) ==> -1 (No such file or directory)
[2013-09-28 09:38:39.099708] I [server3_1-fops.c:298:server_finodelk_cbk] 0-volume-server: 421116625: FINODELK -2 (--) ==> -1 (No such file or directory)
[2013-09-28 09:38:39.111839] I [server3_1-fops.c:1375:server_fsync_cbk] 0-volume-server: 421116626: FSYNC -2 (--) ==> -1 (No such file or directory)

Expected results:
Owners of all directories become "users".

Additional info:
Checking sar, disk I/O is high at the correct time compared with normal time.