Bug 765113 (GLUSTER-3381)

Summary: Gsyncd : master is corrupt and creates core
Product: [Community] GlusterFS Reporter: Lakshmipathi G <lakshmipathi>
Component: geo-replicationAssignee: Venky Shankar <vshankar>
Status: CLOSED UPSTREAM QA Contact: Vijaykumar Koppad <vkoppad>
Severity: medium Docs Contact:
Priority: medium    
Version: 3.2.1CC: bbandari, gluster-bugs, vbellur
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-06-01 10:43:00 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Lakshmipathi G 2011-08-10 08:51:48 UTC
With quota on and  trying to start geo-replication (3.2.2) - It crashed and created core. I'll try and reproduce this and update core file location here.

gsyncd.log 
-----
RuntimeError: master is corrupt
[2011-08-10 07:49:04.740485] I [monitor(monitor):19:set_state] Monitor: new state: faulty
[2011-08-10 07:49:15.140927] I [monitor(monitor):42:monitor] Monitor: ------------------------------------------------------------
[2011-08-10 07:49:15.141160] I [monitor(monitor):43:monitor] Monitor: starting gsyncd worker
[2011-08-10 07:49:15.195079] I [gsyncd:286:main_i] <top>: syncing: gluster://localhost:test -> file:///root/new
[2011-08-10 07:49:20.628334] I [master:181:crawl] GMaster: new master is 5308ad13-2601-4c36-bac2-2225ecd7c97f
[2011-08-10 07:49:20.628670] E [syncdutils:131:exception] <top>: FAIL: 
Traceback (most recent call last):
  File "/opt/glusterfs/3.2.2/local/libexec//glusterfs/python/syncdaemon/gsyncd.py", line 102, in main
    main_i()
  File "/opt/glusterfs/3.2.2/local/libexec//glusterfs/python/syncdaemon/gsyncd.py", line 296, in main_i
    local.service_loop(*[r for r in [remote] if r])
  File "/opt/glusterfs/3.2.2/local/libexec/glusterfs/python/syncdaemon/resource.py", line 401, in service_loop
    GMaster(self, args[0]).crawl_loop()
  File "/opt/glusterfs/3.2.2/local/libexec/glusterfs/python/syncdaemon/master.py", line 113, in crawl_loop
    self.crawl()
  File "/opt/glusterfs/3.2.2/local/libexec/glusterfs/python/syncdaemon/master.py", line 186, in crawl
    raise RuntimeError ("master is corrupt")
RuntimeError: master is corrupt

=========

gluster log
----------
[2011-08-10 08:21:06.200105] D [client-handshake.c:792:client_post_handshake] 0-test-client-0: no open fds - notifying all parents child up
[2011-08-10 08:21:06.200304] D [fuse-bridge.c:3354:notify] 0-fuse: got event 5 on graph 0
[2011-08-10 08:21:06.205029] I [fuse-bridge.c:3336:fuse_graph_setup] 0-fuse: switched to graph 0
[2011-08-10 08:21:06.205180] D [dht-diskusage.c:72:dht_du_info_cbk] 0-test-dht: on subvolume 'test-client-0': avail_percent is: 95.00 and avail_space is: 38689923072
[2011-08-10 08:21:06.205225] D [dht-diskusage.c:72:dht_du_info_cbk] 0-test-dht: on subvolume 'test-client-1': avail_percent is: 95.00 and avail_space is: 38689923072
[2011-08-10 08:21:06.205285] I [fuse-bridge.c:2924:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.10
[2011-08-10 08:21:07.447608] D [libxlator.c:236:cluster_markeruuid_cbk] 0-test-dht: possible NULL deref
pending frames:

patchset: git://git.gluster.com/glusterfs.git
signal received: 11
time of crash: 2011-08-10 08:21:07
configuration details:
argp 1
backtrace 1
dlfcn 1
fdatasync 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 3.2.2
/lib64/libc.so.6[0x2b0930b562d0]
/opt/glusterfs/3.2.2/lib64/glusterfs/3.2.2/xlator/cluster/distribute.so(cluster_markeruuid_cbk+0x168)[0x2aaaabb8e4d8]
/opt/glusterfs/3.2.2/lib64/glusterfs/3.2.2/xlator/protocol/client.so(client3_1_getxattr_cbk+0x1de)[0x2aaaab96193e]
/opt/glusterfs/3.2.2/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0xa2)[0x2b09302e9492]
/opt/glusterfs/3.2.2/lib64/libgfrpc.so.0(rpc_clnt_notify+0x8d)[0x2b09302e968d]
/opt/glusterfs/3.2.2/lib64/libgfrpc.so.0(rpc_transport_notify+0x27)[0x2b09302e42e7]
/opt/glusterfs/3.2.2/lib64/glusterfs/3.2.2/rpc-transport/socket.so(socket_event_poll_in+0x3f)[0x2aaaab52e5ef]
/opt/glusterfs/3.2.2/lib64/glusterfs/3.2.2/rpc-transport/socket.so(socket_event_handler+0x188)[0x2aaaab52e798]
/opt/glusterfs/3.2.2/lib64/libglusterfs.so.0[0x2b09300b8601]
/opt/glusterfs/3.2.2/sbin/glusterfs(main+0x407)[0x405617]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x2b0930b43994]
/opt/glusterfs/3.2.2/sbin/glusterfs[0x403739]
---------