Created attachment 1035030 [details]
server core file

Description of problem:
=======================
Seen the glusterfs crash in one of the 4 node cluster. Not sure of the operations that were performed.

Backtrace:
=========(gdb) bt
#0  0x00007f5448246d87 in fuse_readdir_cbk (frame=<value optimized out>, 
    cookie=0x7f544ead2d70, this=0x14d47b0, op_ret=0, op_errno=107, entries=0x7f54455ea470, 
    xdata=0x0) at fuse-bridge.c:2604
#1  0x00007f543f5c2cf6 in io_stats_readdir_cbk (frame=0x7f544ead2d70, 
    cookie=<value optimized out>, this=<value optimized out>, op_ret=0, op_errno=107, 
    buf=0x7f54455ea470, xdata=0x0) at io-stats.c:1440
#2  0x00007f543f7d752a in mdc_readdirp_cbk (frame=0x7f544ead108c, 
    cookie=<value optimized out>, this=<value optimized out>, op_ret=0, op_errno=107, 
    entries=0x7f54455ea470, xdata=0x0) at md-cache.c:1992
#3  0x00007f543fbe9794 in qr_readdirp_cbk (frame=0x7f544ead1138, 
    cookie=<value optimized out>, this=<value optimized out>, op_ret=0, op_errno=107, 
    entries=0x7f54455ea470, xdata=0x0) at quick-read.c:513
#4  0x00007f543fdf1920 in ioc_readdirp_cbk (frame=0x7f544ead2204, 
    cookie=<value optimized out>, this=<value optimized out>, op_ret=0, op_errno=107, 
    entries=<value optimized out>, xdata=0x0) at io-cache.c:1418
#5  0x00007f5444519338 in dht_readdirp_cbk (frame=0x7f544ead1d50, 
    cookie=<value optimized out>, this=0x7f5440017480, op_ret=0, op_errno=107, 
    orig_entries=<value optimized out>, xdata=0x0) at dht-common.c:4241
#6  0x0000003ccd033c72 in default_readdirp_cbk (frame=0x7f544ead1744, 
    cookie=<value optimized out>, this=<value optimized out>, op_ret=-1, op_errno=107, 
    entries=<value optimized out>, xdata=0x0) at defaults.c:1236
#7  0x00007f54447640a9 in ec_manager_readdir (fop=0x7f543f0dc780, 
    state=<value optimized out>) at ec-dir-read.c:464
#8  0x00007f5444757e14 in __ec_manager (fop=0x7f543f0dc780, error=<value optimized out>)
    at ec-common.c:1875
#9  0x00007f5444757c71 in ec_resume (fop=0x7f543f0dc780, error=0) at ec-common.c:298
#10 0x00007f5444759622 in ec_complete (fop=0x7f543f0dc780) at ec-common.c:359
#11 0x00007f5444763b79 in ec_readdirp_cbk (frame=<value optimized out>, cookie=0x5, 
    this=0x7f5440015790, op_ret=-1, op_errno=107, entries=0x7f54455ea710, xdata=0x0)
    at ec-dir-read.c:579
#12 0x00007f54449ca7bc in client3_3_readdirp_cbk (req=<value optimized out>, 
    iov=<value optimized out>, count=<value optimized out>, myframe=0x7f544ead235c)
    at client-rpc-fops.c:2536
#13 0x0000003ccd80faae in saved_frames_unwind (saved_frames=0x7f5438003730)
    at rpc-clnt.c:366
#14 0x0000003ccd80fb9e in saved_frames_destroy (frames=0x7f5438003730) at rpc-clnt.c:383
#15 0x0000003ccd80fc6b in rpc_clnt_connection_cleanup (conn=0x7f544013f430)
    at rpc-clnt.c:536
#16 0x0000003ccd81022f in rpc_clnt_notify (trans=<value optimized out>, 
    mydata=0x7f544013f430, event=<value optimized out>, data=<value optimized out>)
    at rpc-clnt.c:843
#17 0x0000003ccd80b8e8 in rpc_transport_notify (this=<value optimized out>, 
    event=<value optimized out>, data=<value optimized out>) at rpc-transport.c:543
#18 0x00007f544581d6a1 in socket_event_poll_err (fd=<value optimized out>, 
    idx=<value optimized out>, data=0x7f544014f070, poll_in=<value optimized out>, 
    poll_out=0, poll_err=0) at socket.c:1205
#19 socket_event_handler (fd=<value optimized out>, idx=<value optimized out>, 
    data=0x7f544014f070, poll_in=<value optimized out>, poll_out=0, poll_err=0)
    at socket.c:2410
---Type <return> to continue, or q <return> to quit---
#20 0x0000003ccd081000 in event_dispatch_epoll_handler (data=0x151a8a0) at event-epoll.c:572
#21 event_dispatch_epoll_worker (data=0x151a8a0) at event-epoll.c:674
#22 0x0000003d1b2079d1 in start_thread (arg=0x7f54455eb700) at pthread_create.c:301
#23 0x0000003d1aee89dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:115
(gdb) 

Version-Release number of selected component (if applicable):
=============================================================
[root@interstellar bricks]# gluster --version
glusterfs 3.7.0 built on Jun  1 2015 07:14:51
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.
[root@interstellar bricks]# 


How reproducible:
=================
Seen once


Actual results:


Expected results:


Additional info:
================
Attaching the core file.