I was running sanity tests for top/profile when glusterd crashed. Following is the backtrace. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `glusterd'. Program terminated with signal 6, Aborted. #0 0x00007ff602d5fba5 in raise (sig=<value optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. in ../nptl/sysdeps/unix/sysv/linux/raise.c (gdb) bt #0 0x00007ff602d5fba5 in raise (sig=<value optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 #1 0x00007ff602d636b0 in abort () at abort.c:92 #2 0x00007ff602d58a71 in __assert_fail (assertion=0x7ff600cd6bed "0", file=<value optimized out>, line=2460, function=0x7ff600cd8190 "glusterd_pending_node_get_rpc") at assert.c:81 #3 0x00007ff600c8da3c in glusterd_pending_node_get_rpc (pending_node=0x1c4ce90) at glusterd-utils.c:2460 #4 0x00007ff600c9a636 in glusterd3_1_brick_op (frame=0x0, this=0x161b520, data=0x1665920) at glusterd-rpc-ops.c:2160 #5 0x00007ff600c83bbd in glusterd_op_ac_send_brick_op (event=0x1bf4d10, ctx=0x0) at glusterd-op-sm.c:2863 #6 0x00007ff600c84434 in glusterd_op_sm () at glusterd-op-sm.c:3367 #7 0x00007ff600c758b6 in glusterd_handle_cli_profile_volume (req=0x7ff603ced04c) at glusterd-handler.c:1744 #8 0x00007ff6036f2170 in rpcsvc_handle_rpc_call (svc=0x161f7f0, trans=0x1b86890, msg=0x1c74100) at rpcsvc.c:507 #9 0x00007ff6036f2513 in rpcsvc_notify (trans=0x1b86890, mydata=0x161f7f0, event=RPC_TRANSPORT_MSG_RECEIVED, data=0x1c74100) at rpcsvc.c:603 #10 0x00007ff6036f7fa9 in rpc_transport_notify (this=0x1b86890, event=RPC_TRANSPORT_MSG_RECEIVED, data=0x1c74100) at rpc-transport.c:498 #11 0x00007ff60024f3cc in socket_event_poll_in (this=0x1b86890) at socket.c:1675 #12 0x00007ff60024f950 in socket_event_handler (fd=13, idx=6, data=0x1b86890, poll_in=1, poll_out=0, poll_err=0) at socket.c:1790 #13 0x00007ff603950b4e in event_dispatch_epoll_handler (event_pool=0x1616150, events=0x1622a80, i=0) at event.c:794 #14 0x00007ff603950d71 in event_dispatch_epoll (event_pool=0x1616150) at event.c:856 #15 0x00007ff6039510fc in event_dispatch (event_pool=0x1616150) at event.c:956 #16 0x0000000000407d2c in main (argc=1, argv=0x7fff019874a8) at glusterfsd.c:1592 (gdb) f 0 #0 0x00007ff602d5fba5 in raise (sig=<value optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 in ../nptl/sysdeps/unix/sysv/linux/raise.c (gdb) f 2 #2 0x00007ff602d58a71 in __assert_fail (assertion=0x7ff600cd6bed "0", file=<value optimized out>, line=2460, function=0x7ff600cd8190 "glusterd_pending_node_get_rpc") at assert.c:81 81 assert.c: No such file or directory. in assert.c I have archived core file and I have attached the log file.
CHANGE: http://review.gluster.com/561 (Change-Id: Ib3c73a8432fdd2559422577a2f0c91d50b5a098c) merged in master by Vijay Bellur (vijay)