Created attachment 1048767 [details] core file Description of problem: ======================= NFS crashed while compiling kernel and with append operations. NFS log: ======== [2015-07-06 07:45:23.832283] A [MSGID: 0] [mem-pool.c:120:__gf_calloc] : no memory available for size (34917844374315) [call stack follows] /usr/lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0xb6)[0x7f07d7bed826] /usr/lib64/libglusterfs.so.0(_gf_msg_nomem+0x370)[0x7f07d7bee530] /usr/lib64/libglusterfs.so.0(__gf_calloc+0x139)[0x7f07d7c24959] /usr/lib64/libglusterfs.so.0(iobuf_get_from_stdalloc+0x6e)[0x7f07d7c2633e] /usr/lib64/libglusterfs.so.0(iobuf_get2+0xa3)[0x7f07d7c278e3] [2015-07-06 07:45:23.842655] E [ec-common.c:259:ec_check_complete] (--> 0-: Assertion failed: fop->resume == NULL [2015-07-06 07:45:23.842749] E [ec-common.c:259:ec_check_complete] (--> 0-: Assertion failed: fop->resume == NULL [2015-07-06 07:45:23.842813] W [MSGID: 112018] [nfs3.c:2454:nfs3svc_create_setattr_cbk] 0-nfs: 66e8714c: <gfid:13a56d81-6d50-447c-9efc-619fa8140be4>/linux-4.0.1/arch/ia64/include/uapi/asm/setup.h => -1 (Input/output error) [Input/output error] [2015-07-06 07:45:23.842860] W [MSGID: 112199] [nfs3-helpers.c:3496:nfs3_log_newfh_res] 0-nfs-nfsv3: XID: 66e8714c, CREATE: NFS: 5(I/O error), POSIX: 5(Input/output error), FH: exportid e852b17e-c253-42a6-ba84-ff16b6faa2c5, gfid 3982d8b1-f4a0-4010-9866-965c55813d76, mountid d8655fd7-0000-0000-0000-000000000000 [2015-07-06 07:45:23.842770] W [MSGID: 122040] [ec-common.c:895:ec_prepare_update_cbk] 0-vol3-disperse-0: Failed to get size and version [Input/output error] [2015-07-06 07:45:23.843047] E [ec-generic.c:1362:ec_xattrop_cbk] (--> 0-vol3-disperse-0: invalid argument: frame->local [Invalid argument] [2015-07-06 07:45:23.843619] W [MSGID: 122056] [ec-combine.c:888:ec_combine_check] 0-vol3-disperse-0: Mismatching xdata in answers of 'INODELK' pending frames: frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) pending frames: frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) frame : type(0) op(0) patchset: git://git.gluster.com/glusterfs.git signal received: 11 time of crash: 2015-07-06 07:45:23 configuration details: argp 1 backtrace 1 dlfcn 1 libpthread 1 llistxattr 1 setfsid 1 spinlock 1 epoll.h 1 xattr.h 1 st_atim.tv_nsec 1 package-string: glusterfs 3.7.1 /usr/lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0xb6)[0x7f07d7bed826] /usr/lib64/libglusterfs.so.0(gf_print_trace+0x33f)[0x7f07d7c0d3ef] /lib64/libc.so.6(+0x3f55e326a0)[0x7f07d658c6a0] /usr/lib64/libglusterfs.so.0(dict_destroy+0x30)[0x7f07d7be7c40] /usr/lib64/glusterfs/3.7.1/xlator/protocol/client.so(client3_3_xattrop_cbk+0x1cd)[0x7f07ca4d193d] /usr/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0xa5)[0x7f07d79bc445] /usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x142)[0x7f07d79bd8f2] /usr/lib64/libgfrpc.so.0(rpc_transport_notify+0x28)[0x7f07d79b8ad8] /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so(+0xa255)[0x7f07cc71e255] /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so(+0xbe4d)[0x7f07cc71fe4d] /usr/lib64/libglusterfs.so.0(+0x89970)[0x7f07d7c51970] /lib64/libpthread.so.0(+0x3f56207a51)[0x7f07d6cd8a51] /lib64/libc.so.6(clone+0x6d)[0x7f07d664296d] --------- [root@interstellar ~]# Backtrace: ========= (gdb) bt #0 dict_destroy (this=0x7f07d51b4c1c) at dict.c:564 #1 0x00007f07ca4d193d in client3_3_xattrop_cbk (req=<value optimized out>, iov=<value optimized out>, count=<value optimized out>, myframe=0x7f07d57dc218) at client-rpc-fops.c:1859 #2 0x00007f07d79bc445 in rpc_clnt_handle_reply (clnt=0x7f07c4a643c0, pollin=0x7f07b22da480) at rpc-clnt.c:766 #3 0x00007f07d79bd8f2 in rpc_clnt_notify (trans=<value optimized out>, mydata=0x7f07c4a643f0, event=<value optimized out>, data=<value optimized out>) at rpc-clnt.c:894 #4 0x00007f07d79b8ad8 in rpc_transport_notify (this=<value optimized out>, event=<value optimized out>, data=<value optimized out>) at rpc-transport.c:543 #5 0x00007f07cc71e255 in socket_event_poll_in (this=0x7f07c4a74030) at socket.c:2290 #6 0x00007f07cc71fe4d in socket_event_handler (fd=<value optimized out>, idx=<value optimized out>, data=0x7f07c4a74030, poll_in=1, poll_out=0, poll_err=0) at socket.c:2403 #7 0x00007f07d7c51970 in event_dispatch_epoll_handler (data=0x7f07c4100000) at event-epoll.c:575 #8 event_dispatch_epoll_worker (data=0x7f07c4100000) at event-epoll.c:678 #9 0x00007f07d6cd8a51 in start_thread () from /lib64/libpthread.so.0 #10 0x00007f07d664296d in clone () from /lib64/libc.so.6 (gdb) Version-Release number of selected component (if applicable): ============================================================= [root@interstellar ~]# gluster --version glusterfs 3.7.1 built on Jul 2 2015 21:01:51 Repository revision: git://git.gluster.com/glusterfs.git Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com> GlusterFS comes with ABSOLUTELY NO WARRANTY. You may redistribute copies of GlusterFS under the terms of the GNU General Public License. [root@interstellar ~]# How reproducible: ================= Seen once Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info: ================ Attaching the core file.
verified this on 3.7.1-10 and didn't see the issue. Marking this as fixed
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHSA-2015-1495.html