Created attachment 1035030[details]
server core file
Description of problem:
=======================
Seen the glusterfs crash in one of the 4 node cluster. Not sure of the operations that were performed.
Backtrace:
=========(gdb) bt
#0 0x00007f5448246d87 in fuse_readdir_cbk (frame=<value optimized out>,
cookie=0x7f544ead2d70, this=0x14d47b0, op_ret=0, op_errno=107, entries=0x7f54455ea470,
xdata=0x0) at fuse-bridge.c:2604
#1 0x00007f543f5c2cf6 in io_stats_readdir_cbk (frame=0x7f544ead2d70,
cookie=<value optimized out>, this=<value optimized out>, op_ret=0, op_errno=107,
buf=0x7f54455ea470, xdata=0x0) at io-stats.c:1440
#2 0x00007f543f7d752a in mdc_readdirp_cbk (frame=0x7f544ead108c,
cookie=<value optimized out>, this=<value optimized out>, op_ret=0, op_errno=107,
entries=0x7f54455ea470, xdata=0x0) at md-cache.c:1992
#3 0x00007f543fbe9794 in qr_readdirp_cbk (frame=0x7f544ead1138,
cookie=<value optimized out>, this=<value optimized out>, op_ret=0, op_errno=107,
entries=0x7f54455ea470, xdata=0x0) at quick-read.c:513
#4 0x00007f543fdf1920 in ioc_readdirp_cbk (frame=0x7f544ead2204,
cookie=<value optimized out>, this=<value optimized out>, op_ret=0, op_errno=107,
entries=<value optimized out>, xdata=0x0) at io-cache.c:1418
#5 0x00007f5444519338 in dht_readdirp_cbk (frame=0x7f544ead1d50,
cookie=<value optimized out>, this=0x7f5440017480, op_ret=0, op_errno=107,
orig_entries=<value optimized out>, xdata=0x0) at dht-common.c:4241
#6 0x0000003ccd033c72 in default_readdirp_cbk (frame=0x7f544ead1744,
cookie=<value optimized out>, this=<value optimized out>, op_ret=-1, op_errno=107,
entries=<value optimized out>, xdata=0x0) at defaults.c:1236
#7 0x00007f54447640a9 in ec_manager_readdir (fop=0x7f543f0dc780,
state=<value optimized out>) at ec-dir-read.c:464
#8 0x00007f5444757e14 in __ec_manager (fop=0x7f543f0dc780, error=<value optimized out>)
at ec-common.c:1875
#9 0x00007f5444757c71 in ec_resume (fop=0x7f543f0dc780, error=0) at ec-common.c:298
#10 0x00007f5444759622 in ec_complete (fop=0x7f543f0dc780) at ec-common.c:359
#11 0x00007f5444763b79 in ec_readdirp_cbk (frame=<value optimized out>, cookie=0x5,
this=0x7f5440015790, op_ret=-1, op_errno=107, entries=0x7f54455ea710, xdata=0x0)
at ec-dir-read.c:579
#12 0x00007f54449ca7bc in client3_3_readdirp_cbk (req=<value optimized out>,
iov=<value optimized out>, count=<value optimized out>, myframe=0x7f544ead235c)
at client-rpc-fops.c:2536
#13 0x0000003ccd80faae in saved_frames_unwind (saved_frames=0x7f5438003730)
at rpc-clnt.c:366
#14 0x0000003ccd80fb9e in saved_frames_destroy (frames=0x7f5438003730) at rpc-clnt.c:383
#15 0x0000003ccd80fc6b in rpc_clnt_connection_cleanup (conn=0x7f544013f430)
at rpc-clnt.c:536
#16 0x0000003ccd81022f in rpc_clnt_notify (trans=<value optimized out>,
mydata=0x7f544013f430, event=<value optimized out>, data=<value optimized out>)
at rpc-clnt.c:843
#17 0x0000003ccd80b8e8 in rpc_transport_notify (this=<value optimized out>,
event=<value optimized out>, data=<value optimized out>) at rpc-transport.c:543
#18 0x00007f544581d6a1 in socket_event_poll_err (fd=<value optimized out>,
idx=<value optimized out>, data=0x7f544014f070, poll_in=<value optimized out>,
poll_out=0, poll_err=0) at socket.c:1205
#19 socket_event_handler (fd=<value optimized out>, idx=<value optimized out>,
data=0x7f544014f070, poll_in=<value optimized out>, poll_out=0, poll_err=0)
at socket.c:2410
---Type <return> to continue, or q <return> to quit---
#20 0x0000003ccd081000 in event_dispatch_epoll_handler (data=0x151a8a0) at event-epoll.c:572
#21 event_dispatch_epoll_worker (data=0x151a8a0) at event-epoll.c:674
#22 0x0000003d1b2079d1 in start_thread (arg=0x7f54455eb700) at pthread_create.c:301
#23 0x0000003d1aee89dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:115
(gdb)
Version-Release number of selected component (if applicable):
=============================================================
[root@interstellar bricks]# gluster --version
glusterfs 3.7.0 built on Jun 1 2015 07:14:51
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.
[root@interstellar bricks]#
How reproducible:
=================
Seen once
Actual results:
Expected results:
Additional info:
================
Attaching the core file.
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.
For information on the advisory, and where to find the updated
files, follow the link below.
If the solution does not work for you, open a new bug report.
https://rhn.redhat.com/errata/RHSA-2015-1495.html