Bug 762057 (GLUSTER-325)

Summary: crash in afr_fd_ctx_set
Product: [Community] GlusterFS Reporter: Anand Avati <aavati>
Component: replicateAssignee: Vikas Gorur <vikas>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: medium Docs Contact:
Priority: low    
Version: 2.0.7CC: chrisw, gluster-bugs
Target Milestone: ---   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: ---
Regression: RTP Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Anand Avati 2009-10-19 06:43:47 UTC
================================================================================
Version      : glusterfs 2.0.7 built on Oct 12 2009 00:15:07
git: v2.0.7
Starting Time: 2009-10-17 04:34:30
Command line : glusterfs -f /etc/glusterfs/c-disrep.vol -l /var/log/glusterfs/1c5spostm.log /gmnt 
PID          : 18130
System name  : Linux
Nodename     : compute-241-13.gluster.esaa.intel.com
Kernel Release : 2.6.18-128.el5
Hardware Identifier: x86_64

Given volfile:
+------------------------------------------------------------------------------+
  1: # file: /etc/glusterfs/glusterfs-client.vol
  2: volume n131
  3:   type protocol/client
  4:   option transport-type tcp
  5:   option remote-host n131 
  6:   option remote-subvolume brick
  7: end-volume
  8: 
  9: volume n132
 10:   type protocol/client
 11:   option transport-type tcp
 12:   option remote-host n132
 13:   option remote-subvolume brick
 14: end-volume
 15: 
 16: volume n133
 17:   type protocol/client
 18:   option transport-type tcp
 19:   option remote-host n133
 20:   option remote-subvolume brick
 21: end-volume
 22: 
 23: volume n134
 24:   type protocol/client
 25:   option transport-type tcp
 26:   option remote-host n134
 27:   option remote-subvolume brick
 28: end-volume
 29: 
 30: volume n135
 31:   type protocol/client
 32:   option transport-type tcp
 33:   option remote-host n135
 34:   option remote-subvolume brick
 35: end-volume
 36: 
 37: volume dstr1
 38:   type cluster/distribute
 39:   subvolumes n131 n132 n133 n134 n135
 40: end-volume
 41: 
 42: # file: /etc/glusterfs/glusterfs-client.vol
 43: volume n138
 44:   type protocol/client
 45:   option transport-type tcp
 46:   option remote-host n138
 47:   option remote-subvolume brick
 48: end-volume
 49: 
 50: volume n139
 51:   type protocol/client
 52:   option transport-type tcp
 53:   option remote-host n139
 54:   option remote-subvolume brick
 55: end-volume
 56: 
 57: volume n140
 58:   type protocol/client
 59:   option transport-type tcp
 60:   option remote-host n140
 61:   option remote-subvolume brick
 62: end-volume
 63: 
 64: volume n136
 65:   type protocol/client
 66:   option transport-type tcp
 67:   option remote-host n136
 68:   option remote-subvolume brick
 69: end-volume
 70: 
 71: volume n137
 72:   type protocol/client
 73:   option transport-type tcp
 74:   option remote-host n137
 75:   option remote-subvolume brick
 76: end-volume
 77: 
 78: volume dstr2
 79:   type cluster/distribute
 80:   subvolumes n138 n139 n140 n136 n137
 81: end-volume
 82: 
 83: volume replicate
 84:   type cluster/replicate
 85:   subvolumes dstr1 dstr2
 86: end-volume
 87: 
 88: volume writebehind
 89:   type performance/write-behind
 90:   option window-size 1MB
 91:   subvolumes replicate
 92: end-volume
 93: 
 94: volume cache
 95:   type performance/io-cache
 96:   option cache-size 512MB
 97:   subvolumes writebehind
 98: end-volume
 99:

Comment 1 Anand Avati 2009-10-19 09:42:36 UTC
[2009-10-18 23:43:59] W [fuse-bridge.c:1534:fuse_writev_cbk] glusterfs-fuse: 205471517: WRITE => -1 (No space left on device)
[2009-10-18 23:43:59] W [fuse-bridge.c:882:fuse_err_cbk] glusterfs-fuse: 205471549: FLUSH() ERR => -1 (No space left on device)
[2009-10-18 23:44:05] W [fuse-bridge.c:1365:fuse_create_cbk] glusterfs-fuse: 205471556: /scr142/16048 => -1 (No space left on device)

pending frames:
frame : type(1) op(CREATE)
frame : type(1) op(CREATE)
frame : type(1) op(UNLINK)
frame : type(1) op(UNLINK)

patchset: v2.0.7
signal received: 11
time of crash: 2009-10-18 23:44:07
configuration details:
argp 1
backtrace 1
db.h 1
dlfcn 1
fdatasync 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 2.0.7
/lib64/libc.so.6[0x3e32830280]
/lib64/libpthread.so.0(pthread_spin_lock+0x2)[0x3e3300b0d2]
/opt/glfs/lib/glusterfs/2.0.7/xlator/cluster/replicate.so(afr_fd_ctx_set+0x3b)[0x2aaaab9a603b]
/opt/glfs/lib/glusterfs/2.0.7/xlator/cluster/replicate.so(afr_create_wind_cbk+0x70)[0x2aaaab9adeb0]
/opt/glfs/lib/glusterfs/2.0.7/xlator/cluster/distribute.so(dht_create_linkfile_create_cbk+0x11e)[0x2aaaab78e16e]
/opt/glfs/lib/glusterfs/2.0.7/xlator/cluster/distribute.so(dht_linkfile_create_cbk+0x1a9)[0x2aaaab789e39]
/opt/glfs/lib/glusterfs/2.0.7/xlator/protocol/client.so(client_mknod_cbk+0x184)[0x2aaaab57cec4]
/opt/glfs/lib/glusterfs/2.0.7/xlator/protocol/client.so(protocol_client_pollin+0xca)[0x2aaaab56c7da]
/opt/glfs/lib/glusterfs/2.0.7/xlator/protocol/client.so(notify+0x212)[0x2aaaab5733a2]
/opt/glfs/lib/glusterfs/2.0.7/transport/socket.so(socket_event_handler+0xd3)[0x2aaaac424d03]
/opt/glfs/lib/libglusterfs.so.0[0x2aaaaaad32f5]
glusterfs(main+0x997)[0x403e07]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3e3281d974]
glusterfs[0x402529]

Comment 2 Anand Avati 2009-10-20 04:28:11 UTC
PATCH: http://patches.gluster.com/patch/1954 in master (cluster/afr: Attempt to set fd ctx in create only if the call has succeeded.)

Comment 3 Anand Avati 2009-10-20 04:28:14 UTC
PATCH: http://patches.gluster.com/patch/1955 in release-2.0 (cluster/afr: Attempt to set fd ctx in create only if the call has succeeded.)