Bug 761882 (GLUSTER-150)

Summary: crash in readdir (afr)
Product: [Community] GlusterFS Reporter: Amar Tumballi <amarts>
Component: replicateAssignee: Vikas Gorur <vikas>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: high Docs Contact:
Priority: low    
Version: 2.0.3CC: aavati, gluster-bugs, vinayak, vraman
Target Milestone: ---   
Target Release: ---   
Hardware: All   
OS: All   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: ---
Regression: RTNR Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Anand Avati 2009-07-17 18:17:10 UTC
PATCH: http://patches.gluster.com/patch/770 in release-2.0 (Do not failover readdir in replicate)

Comment 1 Amar Tumballi 2009-07-17 18:18:13 UTC
Amar,
I upgraded last weekend and everything was running smoothly until I
noticed this crash on a client:

[2009-07-17 00:38:25] D [dht-common.c:161:dht_lookup_dir_cbk]
distribute: fixing assignment on
/www/staging/revstr.com/js/yui/examples/fonts/.svn/tmp/text-base/container/.svn/props
[2009-07-17 00:38:25] E [afr-transaction.c:710:afr_changelog_pre_op_cbk]
replicate2: xattrop failed on child sto4-g2: No such file or directory
[2009-07-17 00:38:25] D [dht-common.c:397:dht_lookup_everywhere_cbk]
distribute: found on replicate1 directory
/www/staging/revstr.com/js/yui/examples/fonts/.svn/tmp/text-base/container/.svn/tmp
[2009-07-17 00:38:25] D [dht-common.c:113:dht_lookup_dir_cbk]
distribute: lookup of
/www/staging/revstr.com/js/yui/examples/fonts/.svn/tmp/text-base/container/.svn/tmp
on replicate2 returned error (No such file or directory)
[2009-07-17 00:38:25] D [dht-layout.c:493:dht_layout_normalize]
distribute: found anomalies in
/www/staging/revstr.com/js/yui/examples/fonts/.svn/tmp/text-base/container/.svn/tmp.
holes=1 overlaps=0
[2009-07-17 00:38:25] D [dht-layout.c:507:dht_layout_normalize]
distribute:
path=/www/staging/revstr.com/js/yui/examples/fonts/.svn/tmp/text-base/container/.svn/tmp
err=No such file or directory on subvol=replicate2
[2009-07-17 00:38:25] D [dht-common.c:161:dht_lookup_dir_cbk]
distribute: fixing assignment on
/www/staging/revstr.com/js/yui/examples/fonts/.svn/tmp/text-base/container/.svn/tmp
[2009-07-17 00:38:25] E [afr-transaction.c:710:afr_changelog_pre_op_cbk]
replicate2: xattrop failed on child sto4-g2: No such file or directory
[2009-07-17 00:38:25] D [dht-common.c:68:dht_lookup_selfheal_cbk]
distribute: could not find hashed subvolume for
/www/staging/revstr.com/js/yui/examples/fonts/.svn/tmp/text-base/container/.svn/tmp
pending frames:
frame : type(1) op(READDIR)

patchset: v2.0.3
signal received: 11
configuration details:argp 1
backtrace 1
bdb->cursor->get 1
db.h 1
dlfcn 1
fdatasync 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 2.0.3
[0xbfffe420]
/usr/local/lib/glusterfs/2.0.3/xlator/protocol/client.so(client_readdir+0x167)[0xb75e26e7]
/usr/local/lib/glusterfs/2.0.3/xlator/cluster/replicate.so(afr_readdir_cbk+0x1ac)[0xb75aed9c]
/usr/local/lib/glusterfs/2.0.3/xlator/protocol/client.so(client_readdir+0x167)[0xb75e26e7]
/usr/local/lib/glusterfs/2.0.3/xlator/cluster/replicate.so(afr_readdir+0x2b0)[0xb75aea60]
/usr/local/lib/glusterfs/2.0.3/xlator/cluster/distribute.so(dht_readdir_cbk+0x34f)[0xb759b38f]
/usr/local/lib/glusterfs/2.0.3/xlator/cluster/replicate.so(afr_readdir_cbk+0xa8)[0xb75aec98]
/usr/local/lib/glusterfs/2.0.3/xlator/protocol/client.so(client_readdir_cbk+0xba)[0xb75db5aa]
/usr/local/lib/glusterfs/2.0.3/xlator/protocol/client.so(protocol_client_interpret+0x230)[0xb75d6ee0]
/usr/local/lib/glusterfs/2.0.3/xlator/protocol/client.so(protocol_client_pollin+0xcf)[0xb75d707f]
/usr/local/lib/glusterfs/2.0.3/xlator/protocol/client.so(notify+0x116)[0xb75de536]
/usr/local/lib/glusterfs/2.0.3/transport/socket.so(socket_event_poll_in+0x3b)[0xb6d5495b]
/usr/local/lib/glusterfs/2.0.3/transport/socket.so(socket_event_handler+0xa3)[0xb6d54d73]
/usr/local/lib/libglusterfs.so.0[0xb7fc7919]
/usr/local/lib/libglusterfs.so.0(event_dispatch+0x21)[0xb7fc67e1]
glusterfs(main+0xe86)[0x804b5a6]
/lib/tls/i686/nosegneg/libc.so.6(__libc_start_main+0xe0)[0xb7e47450]
glusterfs[0x8049cd1]
---------

FWIW, here is my glusterfs --version output:

glusterfs 2.0.3 built on Jul 13 2009 12:27:34
Repository revision: v2.0.3
Copyright (c) 2006-2009 Z RESEARCH Inc. <http://www.zresearch.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU
General Public License.