Bug 765458 (GLUSTER-3726)

Summary: nfs server crashed while initializing the inode
Product: [Community] GlusterFS Reporter: Raghavendra Bhat <rabhat>
Component: nfsAssignee: Krishna Srinivas <krishna>
Severity: high Docs Contact:
Priority: medium    
Version: 3.2.4CC: gluster-bugs
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Description Krishna Srinivas 2011-10-17 00:29:52 EDT

*** This bug has been marked as a duplicate of bug 3572 ***
Comment 1 Raghavendra Bhat 2011-10-17 03:22:15 EDT
nfs server crashed due to abort while initializing the inode. 

replicate volume with replica count 2. 2 fuse and 1 nfs client. 1 fuse client was running sanity script, other fuse client was running fs-perf test and the nfs client was running sanity script along with find | xargs stat.

Brought one brick down, slept and brought it up. Volume set operations were going on in a loop on the machine which had other brick of the volume. nfs server crashed with the below backtrace.

Core was generated by `/opt/glusterfs/3.2.4/sbin/glusterfs -f /etc/glusterd/nfs/nfs-server.vol -p /etc'.
Program terminated with signal 6, Aborted.
#0  0x0000003c83e32905 in raise () from /lib64/libc.so.6
Missing separate debuginfos, use: debuginfo-install glusterfs-core-3.2.4-1.el6.x86_64
(gdb) bt
#0  0x0000003c83e32905 in raise () from /lib64/libc.so.6
#1  0x0000003c83e340e5 in abort () from /lib64/libc.so.6
#2  0x0000003c83e6f827 in __libc_message () from /lib64/libc.so.6
#3  0x0000003c83eff397 in __fortify_fail () from /lib64/libc.so.6
#4  0x0000003c83efd280 in __chk_fail () from /lib64/libc.so.6
#5  0x00007fee49e4f65a in nfl_inodes_init () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/nfs/server.so
#6  0x00007fee49e500bd in nfs_inode_create () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/nfs/server.so
#7  0x00007fee49e5602e in nfs3_create_exclusive () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/nfs/server.so
#8  0x00007fee49e59b38 in nfs3_create_resume () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/nfs/server.so
#9  0x00007fee49e64aec in nfs3_fh_resolve_entry_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/nfs/server.so
#10 0x00007fee49e4c249 in nfs_fop_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/nfs/server.so
#11 0x00007fee4a09517b in io_stats_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/debug/io-stats.so
#12 0x00007fee4a2abd2e in qr_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/performance/quick-read.so
#13 0x00007fee4a4beb45 in ioc_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/performance/io-cache.so
#14 0x00007fee4cdde92b in default_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/libglusterfs.so.0
#15 0x00007fee4cdde92b in default_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/libglusterfs.so.0
#16 0x00007fee4aaedd52 in quota_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/features/quota.so
#17 0x00007fee4ad36a24 in ?? () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/cluster/replicate.so
#18 0x00007fee4ad38300 in afr_fresh_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/cluster/replicate.so
#19 0x00007fee4af6bef0 in client3_1_lookup_cbk () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/xlator/protocol/client.so
#20 0x00007fee4cbad365 in rpc_clnt_handle_reply () from /opt/glusterfs/3.2.4/lib64/libgfrpc.so.0
#21 0x00007fee4cbad5b9 in rpc_clnt_notify () from /opt/glusterfs/3.2.4/lib64/libgfrpc.so.0
#22 0x00007fee4cba8458 in rpc_transport_notify () from /opt/glusterfs/3.2.4/lib64/libgfrpc.so.0
#23 0x00007fee43df9254 in socket_event_poll_in () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/rpc-transport/socket.so
#24 0x00007fee43df9337 in socket_event_handler () from /opt/glusterfs/3.2.4/lib64/glusterfs/3.2.4/rpc-transport/socket.so
#25 0x00007fee4cdf4504 in ?? () from /opt/glusterfs/3.2.4/lib64/libglusterfs.so.0
#26 0x0000000000405e99 in main ()