Bug 1553543

Summary: Glusterfs-3.12.5 does not support kernel-4.14.14 and cannot start glusterfs.
Product: [Community] GlusterFS Reporter: Stone xu <longjuxu>
Component: glusterdAssignee: bugs <bugs>
Status: CLOSED INSUFFICIENT_DATA QA Contact:
Severity: high Docs Contact:
Priority: unspecified    
Version: mainlineCC: amukherj, bugs, longjuxu, vbellur
Target Milestone: ---Flags: longjuxu: needinfo-
longjuxu: needinfo-
longjuxu: needinfo-
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-12-05 06:52:11 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Stone xu 2018-03-09 02:58:27 UTC 
Hi All:

Basic information：
Centos6.5 
kernel
4.14.14
Glusterfs - 3.12.5
gcc 4.9.2
python 2.7.13

I can't start the glusterfs（3.12.5） service, and kernel changes to 4.9.11.

Start log information（glustefsd.log）：
[2018-03-08 07:54:50.103546] E [MSGID: 101032] [store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to /opt/data/glusterfs/lib/glusterd/glusterd.info. [没有那个文件或目录]
[2018-03-08 07:54:50.103713] E [MSGID: 101032] [store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to /opt/data/glusterfs/lib/glusterd/glusterd.info. [没有那个文件或目录]
pending frames:
frame : type(0) op(0)
patchset: git://git.gluster.org/glusterfs.git
signal received: 6
time of crash:
2018-03-08 07:54:50
configuration details:
argp 1
backtrace 1
dlfcn 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs
/opt/websuite/glusterfs/lib/libglusterfs.so.0(_gf_msg_backtrace_nomem+0x8c)[0x7f13164dc66c]
/opt/websuite/glusterfs/lib/libglusterfs.so.0(gf_print_trace+0x2f4)[0x7f13164e52b4]
/lib64/libc.so.6(+0x326b0)[0x7f1314c6f6b0]
/lib64/libc.so.6(gsignal+0x35)[0x7f1314c6f635]
/lib64/libc.so.6(abort+0x175)[0x7f1314c70e15]
/lib64/libc.so.6(+0x2b75e)[0x7f1314c6875e]
/lib64/libc.so.6(__assert_perror_fail+0x0)[0x7f1314c68820]
/usr/lib64/liburcu-bp.so.1(rcu_bp_register+0x288)[0x7f130c5ce4a8]
/usr/lib64/liburcu-bp.so.1(rcu_read_lock_bp+0x4e)[0x7f130c5ce51e]
/opt/websuite/glusterfs/lib/glusterfs//xlator/mgmt/glusterd.so(+0x10625c)[0x7f130cc2a25c]
/opt/websuite/glusterfs/lib/glusterfs//xlator/mgmt/glusterd.so(+0x47ca2)[0x7f130cb6bca2]
/opt/websuite/glusterfs/lib/glusterfs//xlator/mgmt/glusterd.so(+0x59e64)[0x7f130cb7de64]
/opt/websuite/glusterfs/lib/libglusterfs.so.0(synctask_wrap+0x10)[0x7f131650f430]
/lib64/libc.so.6(+0x43900)[0x7f1314c80900]
Please help me，thank you！
Comment 1 Atin Mukherjee 2018-03-09 14:12:02 UTC 
Gaurav - can you please check this?
Comment 2 Stone xu 2018-03-11 02:40:49 UTC 
Check what the kernel is?
Comment 3 Atin Mukherjee 2018-03-12 02:16:57 UTC 
FWIW, it'd be good to capture the backtrace of the core dump along with attaching the core. You should be able to see a core dump file in your system and if you attach this to gdb (gdb <core file> glusterd) and do a 't a a bt' that would provide us the complete backtrace.
Comment 4 Stone xu 2018-03-14 01:29:24 UTC 
[root@localhost tmp]# gdb glusterd corefile-glustersproc0-27408-1520905047 
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /opt/websuite/glusterfs/sbin/glusterd...done.
[New Thread 27412]
[New Thread 27417]
[New Thread 27408]
[New Thread 27414]
[New Thread 27409]
[New Thread 27410]
[New Thread 27413]
[New Thread 27411]
[New Thread 27416]
[New Thread 27419]
[New Thread 27415]
Reading symbols from /opt/websuite/glusterfs/lib/libglusterfs.so.0...done.
Loaded symbols for /opt/websuite/glusterfs/lib/libglusterfs.so.0
Reading symbols from /opt/websuite/glusterfs/lib/libgfrpc.so.0...done.
Loaded symbols for /opt/websuite/glusterfs/lib/libgfrpc.so.0
Reading symbols from /opt/websuite/glusterfs/lib/libgfxdr.so.0...done.
Loaded symbols for /opt/websuite/glusterfs/lib/libgfxdr.so.0
Reading symbols from /opt/websuite/glusterfs/common/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libz.so.1
Reading symbols from /opt/websuite/glusterfs/common/libuuid.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libuuid.so.1
Reading symbols from /opt/websuite/glusterfs/common/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libm.so.6
Reading symbols from /opt/websuite/glusterfs/common/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/librt.so.1
Reading symbols from /opt/websuite/glusterfs/common/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /opt/websuite/glusterfs/common/libpthread.so.0
Reading symbols from /opt/websuite/glusterfs/common/libcrypto.so.10...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libcrypto.so.10
Reading symbols from /opt/websuite/glusterfs/common/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libc.so.6
Reading symbols from /opt/websuite/glusterfs/common/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libdl.so.2
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /opt/websuite/glusterfs/lib/glusterfs//xlator/mgmt/glusterd.so...done.
Loaded symbols for /opt/websuite/glusterfs/lib/glusterfs//xlator/mgmt/glusterd.so
Reading symbols from /usr/lib64/libxml2.so.2...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libxml2.so.2
Reading symbols from /opt/websuite/glusterfs/common/liburcu-bp.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/liburcu-bp.so.1
Reading symbols from /opt/websuite/glusterfs/common/liburcu-cds.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/liburcu-cds.so.1
Reading symbols from /opt/websuite/glusterfs/common/liblvm2app.so.2.2...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/liblvm2app.so.2.2
Reading symbols from /opt/websuite/glusterfs/common/liburcu-common.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/liburcu-common.so.1
Reading symbols from /opt/websuite/glusterfs/common/libudev.so.0...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libudev.so.0
Reading symbols from /opt/websuite/glusterfs/common/libdevmapper.so.1.02...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libdevmapper.so.1.02
Reading symbols from /opt/websuite/glusterfs/common/libdevmapper-event.so.1.02...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libdevmapper-event.so.1.02
Reading symbols from /opt/websuite/glusterfs/common/libselinux.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libselinux.so.1
Reading symbols from /lib64/libsepol.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libsepol.so.1
Reading symbols from /opt/websuite/glusterfs/lib/glusterfs//rpc-transport/socket.so...done.
Loaded symbols for /opt/websuite/glusterfs/lib/glusterfs//rpc-transport/socket.so
Reading symbols from /opt/websuite/glusterfs/common/libssl.so.10...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libssl.so.10
Reading symbols from /opt/websuite/glusterfs/common/libgssapi_krb5.so.2...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libgssapi_krb5.so.2
Reading symbols from /opt/websuite/glusterfs/common/libkrb5.so.3...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libkrb5.so.3
Reading symbols from /opt/websuite/glusterfs/common/libcom_err.so.2...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libcom_err.so.2
Reading symbols from /opt/websuite/glusterfs/common/libk5crypto.so.3...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libk5crypto.so.3
Reading symbols from /opt/websuite/glusterfs/common/libkrb5support.so.0...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libkrb5support.so.0
Reading symbols from /opt/websuite/glusterfs/common/libkeyutils.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libkeyutils.so.1
Reading symbols from /opt/websuite/glusterfs/common/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /opt/websuite/glusterfs/common/libresolv.so.2
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Core was generated by `/opt/websuite/glusterfs/sbin/glusterd --pid-file=/opt/run/glusterfs/glusterd.pi'.
Program terminated with signal 6, Aborted.
#0  0x00007fc78cfe7635 in raise () from /opt/websuite/glusterfs/common/libc.so.6
Missing separate debuginfos, use: debuginfo-install glusterfs-3.12.5-el6.x86_64
Comment 5 Stone xu 2018-03-16 06:49:01 UTC 
kernel: glustersproc0 (1022): attempted to duplicate a private mapping with mremap.  This is not supported.
Comment 6 Atin Mukherjee 2018-10-05 02:45:21 UTC 
Are you still seeing this issue?
Comment 7 Shyamsundar 2018-10-23 14:55:04 UTC 
Release 3.12 has been EOLd and this bug was still found to be in the NEW state, hence moving the version to mainline, to triage the same and take appropriate actions.
Comment 8 Vijay Bellur 2018-11-20 05:21:59 UTC 
(In reply to Stone xu from comment #5)
> kernel: glustersproc0 (1022): attempted to duplicate a private mapping with
> mremap.  This is not supported.

Any updates on this one? Are you still experiencing the problem? Thanks.
Comment 9 Atin Mukherjee 2018-12-05 06:52:11 UTC 
Closing this bug as we haven't heard anything back from the reporter.