Hide Forgot
While doing rsync of /usr to the mount point of 5 subvolume distribute setup, ESTALE errors were found. [2010-09-06 02:00:08.764845] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels) inode (ptr=0x2aaab62abce8, ino=149260700, gen=551) [2010-09-06 02:00:08.765919] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels/2.6.18-194.3.1.el5-x86_64 on client5 returned er) [2010-09-06 02:00:08.766164] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels/2.6.18-194.3.1.el5-x86_64 err=Stale NFS file handle5 [2010-09-06 02:00:08.766190] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels/2.6.18-194.3.1.el5-x86_64) inode (ptr=0x2aaab62abc) [2010-09-06 02:00:08.767593] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound on client5 retur) [2010-09-06 02:00:08.767841] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound err=Stale NFS file 5 [2010-09-06 02:00:08.767882] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound) inode (ptr=0x2aaa) [2010-09-06 02:00:08.769018] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound/usb on client5 r) [2010-09-06 02:00:08.769271] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound/usb err=Stale NFS f5 [2010-09-06 02:00:08.769298] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound/usb) inode (ptr=0x) [2010-09-06 02:00:08.770574] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound/usb/usx2y on cli) [2010-09-06 02:00:08.770838] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound/usb/usx2y err=Stale5 [2010-09-06 02:00:08.770865] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/sound/usb/usx2y) inode () [2010-09-06 02:00:08.770983] D [dht-common.c:4335:dht_setattr_cbk] distribute: subvolume client5 returned -1 (No such file or directory) [2010-09-06 02:00:08.773902] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels on client5 returned error (Stale NFS file handle) [2010-09-06 02:00:08.774139] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels err=Stale NFS file handle on subvol=client5 [2010-09-06 02:00:08.774163] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels) inode (ptr=0x2aaab62abce8, ino=149260700, gen=551) [2010-09-06 02:00:08.775214] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels/2.6.18-194.3.1.el5-x86_64 on client5 returned er) [2010-09-06 02:00:08.775452] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels/2.6.18-194.3.1.el5-x86_64 err=Stale NFS file handle5 [2010-09-06 02:00:08.775476] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels/2.6.18-194.3.1.el5-x86_64) inode (ptr=0x2aaab62abc) [2010-09-06 02:00:08.776583] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels/2.6.18-194.3.1.el5-x86_64/usr on client5 returne) [2010-09-06 02:00:08.776841] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/usr err=Stale NFS file ha5 [2010-09-06 02:00:08.776870] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/usr) inode (ptr=0x2aaab6) [2010-09-06 02:00:08.779665] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels on client5 returned error (Stale NFS file handle) [2010-09-06 02:00:08.779900] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels err=Stale NFS file handle on subvol=client5 [2010-09-06 02:00:08.779924] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels) inode (ptr=0x2aaab62abce8, ino=149260700, gen=551) [2010-09-06 02:00:08.781283] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels/2.6.18-194.3.1.el5-x86_64 on client5 returned er) [2010-09-06 02:00:08.781482] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels/2.6.18-194.3.1.el5-x86_64 err=Stale NFS file handle5 [2010-09-06 02:00:08.781514] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels/2.6.18-194.3.1.el5-x86_64) inode (ptr=0x2aaab62ad7) [2010-09-06 02:00:08.782625] D [dht-common.c:118:dht_lookup_dir_cbk] distribute: lookup of /usr/src/kernels/2.6.18-194.3.1.el5-x86_64/usr on client5 returne) [2010-09-06 02:00:08.782875] D [dht-layout.c:589:dht_layout_normalize] distribute: path=/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/usr err=Stale NFS file ha5 [2010-09-06 02:00:08.782903] W [fuse-bridge.c:155:fuse_entry_cbk] glusterfs-fuse: LOOKUP(/usr/src/kernels/2.6.18-194.3.1.el5-x86_64/usr) inode (ptr=0x2aaab6) [2010-09-06 02:00:08.783015] D [dht-common.c:4335:dht_setattr_cbk] distribute: subvolume client5 returned -1 (No such file or directory)
client5 had no free disk space. Hence creation of parent directory was failed resulting in ESTALE