Description of problem: When glusterfs is build on fuse mount with error-gen enabled, the fuse mount crashes


Version-Release number of selected component (if applicable): upstream


How reproducible: Consistently


Steps to Reproduce:
1. Add error-gen translator below locks
2. Run glusterfs build on the fuse mount
3.
  
Actual results:

Client Crashes.




Additional info:

Volume Name: eg_vol
Type: Distributed-Replicate
Volume ID: d9f846d6-ca28-4741-8f7e-81f0efd3cc76
Status: Started
Number of Bricks: 2 x 2 = 4
Transport-type: tcp
Bricks:
Brick1: gqac032.sbu.lab.eng.bos.redhat.com:/mnt/s0
Brick2: gqac032.sbu.lab.eng.bos.redhat.com:/mnt/s1
Brick3: gqac032.sbu.lab.eng.bos.redhat.com:/mnt/s2
Brick4: gqac032.sbu.lab.eng.bos.redhat.com:/mnt/s3


//Error-gen translator below locks in the brick vol files.

volume eg_vol-posix
    type storage/posix
    option directory /mnt/s0
    option volume-id d9f846d6-ca28-4741-8f7e-81f0efd3cc76
end-volume

volume eg_vol-access-control
    type features/access-control
    subvolumes eg_vol-posix
end-volume

volume eg
    type debug/error-gen
    option failure 5
    option random-failure on
    subvolumes eg_vol-access-control
end-volume

volume eg_vol-locks
    type features/locks
subvolumes eg
end-volume

volume eg_vol-io-threads
    type performance/io-threads
    subvolumes eg_vol-locks
end-volume

--

Client log-
[2012-08-06 09:13:30.523803] T [rpc-clnt.c:1306:rpc_clnt_record] 0-eg_vol-client-1: Auth Info: pid: 21079, uid: 0, gid: 0, owner: 0000000000000000
[2012-08-06 09:13:30.523812] T [rpc-clnt.c:1186:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 220, payload: 124, rpc hdr: 96
[2012-08-06 09:13:30.523836] T [rpc-clnt.c:1507:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x14325x Program: GlusterFS 3.3, ProgVers: 330, P
roc: 38) to rpc-transport (eg_vol-client-1)
[2012-08-06 09:13:30.523914] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-eg_vol-client-0: received rpc message (RPC XID: 0x16485x Program: GlusterFS 3.3,
 ProgVers: 330, Proc: 38) from rpc-transport (eg_vol-client-0)
[2012-08-06 09:13:30.523929] T [fuse-bridge.c:856:fuse_setattr_cbk] 0-glusterfs-fuse: 20943: SETATTR() /run20391/glusterfs-3.0.0pre2/xlators/cluster/d
ht/src/dht.c => -7546560316021240563
[2012-08-06 09:13:30.523964] T [write-behind.c:693:wb_sync] 0-eg_vol-write-behind: no vectors are to be synced
[2012-08-06 09:13:30.524014] T [fuse-resolve.c:61:fuse_resolve_loc_touchup] 0-fuse: return value inode_path 59
[2012-08-06 09:13:30.524022] T [fuse-bridge.c:946:fuse_setattr_resume] 0-glusterfs-fuse: 20945: SETATTR (140409809837916)/run20391/glusterfs-3.0.0pre2
/xlators/cluster/dht/src/dht.c 
[2012-08-06 09:13:30.524051] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-eg_vol-client-1: received rpc message (RPC XID: 0x14325x Program: GlusterFS 3.3,
 ProgVers: 330, Proc: 38) from rpc-transport (eg_vol-client-1)
[2012-08-06 09:13:30.524077] D [afr-lk-common.c:403:transaction_lk_op] 0-eg_vol-replicate-0: lk op is for a transaction
[2012-08-06 09:13:30.524095] T [rpc-clnt.c:1306:rpc_clnt_record] 0-eg_vol-client-0: Auth Info: pid: 21079, uid: 0, gid: 0, owner: 744071bbb37f0000
[2012-08-06 09:13:30.524104] T [rpc-clnt.c:1186:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 180, payload: 84, rpc hdr: 96
[2012-08-06 09:13:30.524107] D [mem-pool.c:431:mem_get] (-->/usr/local/lib/libglusterfs.so.0(default_setattr+0x228) [0x7fb3bcaf904c] (-->/usr/local/li
b/glusterfs/3git/xlator/performance/write-behind.so(wb_setattr+0x14a) [0x7fb3b8a0f70e] (-->/usr/local/lib/libglusterfs.so.0(mem_get0+0x5f) [0x7fb3bcb1
9776]))) 0-mem-pool: Mem pool is full. Callocing mem
[2012-08-06 09:13:30.524119] T [write-behind.c:693:wb_sync] 0-eg_vol-write-behind: no vectors are to be synced
[2012-08-06 09:13:30.524129] T [afr-lk-common.c:90:afr_set_lk_owner] 0-eg_vol-replicate-0: Setting lk-owner=140409920676676
[2012-08-06 09:13:30.525192] T [rpc-clnt.c:1186:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 220, payload: 124, rpc hdr: 96
[2012-08-06 09:13:30.525210] T [rpc-clnt.c:1507:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x16491x Program: GlusterFS 3.3, ProgVers: 330, Proc: 38) to rpc-transport (eg_vol-client-0)
[2012-08-06 09:13:30.525226] T [rpc-clnt.c:1306:rpc_clnt_record] 0-eg_vol-client-1: Auth Info: pid: 21079, uid: 0, gid: 0, owner: 0000000000000000
[2012-08-06 09:13:30.525234] T [rpc-clnt.c:1186:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 220, payload: 124, rpc hdr: 96
[2012-08-06 09:13:30.525258] T [rpc-clnt.c:1507:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x14331x Program: GlusterFS 3.3, ProgVers: 330, Proc: 38) to rpc-transport (eg_vol-client-1)
[2012-08-06 09:13:30.525334] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-eg_vol-client-0: received rpc message (RPC XID: 0x16491x Program: GlusterFS 3.3, ProgVers: 330, Proc: 38) from rpc-transport (eg_vol-client-0)
[2012-08-06 09:13:30.525343] W [client-rpc-fops.c:1974:client3_3_setattr_cbk] 0-eg_vol-client-0: remote operation failed: No such file or directory
[2012-08-06 09:13:30.525414] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-eg_vol-client-1: received rpc message (RPC XID: 0x14331x Program: GlusterFS 3.3, ProgVers: 330, Proc: 38) from rpc-transport (eg_vol-client-1)
[2012-08-06 09:13:30.525427] W [pending frames:
frame : type(1) op(SETATTR)
frame : type(1) op(SETATTR)

patchset: git://git.gluster.com/glusterfs.git
signal received: 11
time of crash: 2012-08-06 09:13:30configuration details:
argp 1
backtrace 1
dlfcn 1
fdatasync 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 3git
/usr/local//sbin/glusterfs(glusterfsd_print_trace+0x22)[0x407a40]
/lib64/libc.so.6[0x3df3232900]