Attachment 577299 Details for Bug 812314 – croped master log.

croped master log.

master.log (text/x-log), 25.62 KB, created by Vijaykumar Koppad on 2012-04-13 11:03:07 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Vijaykumar Koppad

Created: 2012-04-13 11:03:07 UTC

Size: 25.62 KB

patch

obsolete

>[2012-04-12 23:08:11.879412] E [repce:188:__call__] RepceClient: call 4162:140503405811456:1334286491.22 (purge) failed on peer with OSError
>[2012-04-12 23:08:11.879622] E [syncdutils:184:log_raise_exception] <top>: FAIL: 
>Traceback (most recent call last):
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 115, in main
>    main_i()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 366, in main_i
>    local.service_loop(*[r for r in [remote] if r])
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/resource.py", line 740, in service_loop
>    GMaster(self, args[0]).crawl_loop()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 143, in crawl_loop
>    self.crawl()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 353, in crawl
>    self.slave.server.purge(path, dd)
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/repce.py", line 204, in __call__
>    return self.ins(self.meth, *a)
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/repce.py", line 189, in __call__
>    raise res
>OSError: [Errno 2] No such file or directory: './15589'
>[2012-04-12 23:08:11.880678] I [syncdutils:142:finalize] <top>: exiting.
>[2012-04-12 23:08:11.891452] I [monitor(monitor):21:set_state] Monitor: new state: faulty
>[2012-04-12 23:08:17.417025] I [monitor(monitor):21:set_state] Monitor: new state: OK
>[2012-04-12 23:08:21.903330] I [monitor(monitor):80:monitor] Monitor: ------------------------------------------------------------
>[2012-04-12 23:08:21.903671] I [monitor(monitor):81:monitor] Monitor: starting gsyncd worker
>[2012-04-12 23:08:22.30622] I [gsyncd:355:main_i] <top>: syncing: gluster://localhost:master -> ssh://172.17.251.57::slave
>[2012-04-12 23:08:26.364900] I [master:272:crawl] GMaster: completed 36 crawls, 1 turns
>[2012-04-12 23:08:31.751432] I [master:284:crawl] GMaster: new master is 0477ea38-ae95-402d-aab6-411112557e82
>[2012-04-12 23:08:31.751890] I [master:288:crawl] GMaster: primary master with volume id 0477ea38-ae95-402d-aab6-411112557e82 ...
>[2012-04-12 23:09:22.728096] I [monitor(monitor):21:set_state] Monitor: new state: OK
>[2012-04-12 23:09:26.959052] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:09:31.441580] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:10:27.565421] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:10:32.82814] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:11:28.171128] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:11:32.685189] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:12:28.782810] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:12:33.301884] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:13:29.403384] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:13:33.902965] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:14:30.18265] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:14:34.525207] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:14:37.135256] E [syncdutils:184:log_raise_exception] <top>: FAIL: 
>Traceback (most recent call last):
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 115, in main
>    main_i()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 366, in main_i
>    local.service_loop(*[r for r in [remote] if r])
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/resource.py", line 740, in service_loop
>    GMaster(self, args[0]).crawl_loop()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 143, in crawl_loop
>    self.crawl()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 276, in crawl
>    volinfo_sys = self.get_sys_volinfo()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 28, in get_sys_volinfo
>    fgn_vis, nat_vi = self.master.server.foreign_volume_infos(), \
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/resource.py", line 570, in foreign_volume_infos
>    xattr_list = Xattr.llistxattr_buf('.')
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 72, in llistxattr_buf
>    return cls.llistxattr(path, size)
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 47, in llistxattr
>    ret = cls._query_xattr(path, siz, 'llistxattr')
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 35, in _query_xattr
>    cls.raise_oserr()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 25, in raise_oserr
>    raise OSError(errn, os.strerror(errn))
>OSError: [Errno 103] Software caused connection abort
>[2012-04-12 23:14:37.146224] I [syncdutils:142:finalize] <top>: exiting.
>[2012-04-12 23:14:37.152394] I [monitor(monitor):21:set_state] Monitor: new state: faulty
>[2012-04-12 23:14:37.563153] E [syncdutils:184:log_raise_exception] <top>: FAIL: 
>Traceback (most recent call last):
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 115, in main
>    main_i()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 366, in main_i
>    local.service_loop(*[r for r in [remote] if r])
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/resource.py", line 740, in service_loop
>    GMaster(self, args[0]).crawl_loop()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 143, in crawl_loop
>    self.crawl()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 276, in crawl
>    volinfo_sys = self.get_sys_volinfo()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 28, in get_sys_volinfo
>    fgn_vis, nat_vi = self.master.server.foreign_volume_infos(), \
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/resource.py", line 570, in foreign_volume_infos
>    xattr_list = Xattr.llistxattr_buf('.')
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 72, in llistxattr_buf
>    return cls.llistxattr(path, size)
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 47, in llistxattr
>    ret = cls._query_xattr(path, siz, 'llistxattr')
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 35, in _query_xattr
>    cls.raise_oserr()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 25, in raise_oserr
>    raise OSError(errn, os.strerror(errn))
>OSError: [Errno 103] Software caused connection abort
>[2012-04-12 23:14:37.566950] I [syncdutils:142:finalize] <top>: exiting.
>[2012-04-12 23:14:37.577462] I [monitor(monitor):21:set_state] Monitor: new state: faulty
>[2012-04-12 23:14:47.171427] I [monitor(monitor):80:monitor] Monitor: ------------------------------------------------------------
>[2012-04-12 23:14:47.171765] I [monitor(monitor):81:monitor] Monitor: starting gsyncd worker
>[2012-04-12 23:14:47.259327] I [gsyncd:355:main_i] <top>: syncing: gluster://localhost:master -> ssh://172.17.251.57::slave
>[2012-04-12 23:14:47.590925] I [monitor(monitor):80:monitor] Monitor: ------------------------------------------------------------
>[2012-04-12 23:14:47.591207] I [monitor(monitor):81:monitor] Monitor: starting gsyncd worker
>[2012-04-12 23:14:47.686208] I [gsyncd:355:main_i] <top>: syncing: gluster://localhost:master -> ssh://172.17.251.57::slave
>[2012-04-12 23:14:57.28901] I [master:284:crawl] GMaster: new master is 0477ea38-ae95-402d-aab6-411112557e82
>[2012-04-12 23:14:57.29325] I [master:288:crawl] GMaster: primary master with volume id 0477ea38-ae95-402d-aab6-411112557e82 ...
>[2012-04-12 23:14:57.584534] I [master:284:crawl] GMaster: new master is 0477ea38-ae95-402d-aab6-411112557e82
>[2012-04-12 23:14:57.584997] I [master:288:crawl] GMaster: primary master with volume id 0477ea38-ae95-402d-aab6-411112557e82 ...
>[2012-04-12 23:15:47.989924] I [monitor(monitor):21:set_state] Monitor: new state: OK
>[2012-04-12 23:15:48.466567] I [monitor(monitor):21:set_state] Monitor: new state: OK
>[2012-04-12 23:15:56.836607] I [master:272:crawl] GMaster: completed 58 crawls, 1 turns
>[2012-04-12 23:15:56.839356] I [master:272:crawl] GMaster: completed 58 crawls, 1 turns
>[2012-04-12 23:16:57.141810] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:16:57.142292] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:17:57.447693] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:17:57.449578] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:18:57.747046] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:18:57.747471] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:19:58.582995] I [master:272:crawl] GMaster: completed 58 crawls, 2 turns
>[2012-04-12 23:19:58.631963] I [master:272:crawl] GMaster: completed 58 crawls, 0 turns
>[2012-04-12 23:20:58.982848] I [master:272:crawl] GMaster: completed 45 crawls, 2 turns
>[2012-04-12 23:20:59.31042] I [master:272:crawl] GMaster: completed 45 crawls, 2 turns
>[2012-04-12 23:21:59.819528] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:21:59.832912] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:23:00.134478] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:23:00.134999] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:24:00.424220] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:24:00.425276] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:25:00.745359] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:25:00.745980] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:26:01.46298] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:26:01.46802] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:27:01.358683] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:27:01.359168] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:28:01.721779] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:28:01.722223] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:29:02.65543] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:29:02.66028] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:30:02.879443] I [master:272:crawl] GMaster: completed 52 crawls, 1 turns
>[2012-04-12 23:30:02.984009] I [master:272:crawl] GMaster: completed 52 crawls, 1 turns
>[2012-04-12 23:31:03.746783] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:31:03.782423] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:32:03.829152] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:32:03.831343] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:33:04.190541] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:33:04.192383] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:34:04.509123] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:34:04.509603] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:35:04.812150] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:35:04.813971] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:36:05.171260] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:36:05.171730] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:37:05.508405] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:37:05.508883] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:38:05.797506] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:38:05.797868] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:39:05.798921] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:39:05.799839] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:40:05.967434] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:40:05.968086] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:41:06.273011] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:41:06.274127] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:42:06.549681] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:42:06.550179] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:43:07.527884] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:43:07.530482] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-12 23:44:07.848491] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:44:07.850930] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:45:08.150712] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:45:08.151161] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:46:08.475238] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:46:08.478918] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:47:08.791721] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:47:08.792186] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:48:09.103276] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:48:09.104115] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:49:09.414614] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:49:09.415106] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:50:09.732580] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:50:09.733073] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:51:10.37976] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:51:10.39206] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:52:10.359996] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:52:10.362708] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:53:10.706291] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:53:10.707530] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:54:11.21822] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:54:11.22293] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:55:11.328599] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:55:11.329071] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:56:11.649897] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:56:11.651129] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:57:11.976990] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:57:11.979885] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:58:12.296848] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:58:12.297310] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:59:12.632206] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-12 23:59:12.632688] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:00:12.960774] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:00:12.962003] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:01:13.300894] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:01:13.301420] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:02:13.621901] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:02:13.622318] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:03:14.561902] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-13 00:03:14.563154] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-13 00:04:14.789164] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:04:14.790899] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:05:15.103637] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:05:15.105592] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:06:15.423141] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:06:15.423868] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:07:16.854983] I [master:272:crawl] GMaster: completed 44 crawls, 0 turns
>[2012-04-13 00:07:16.900970] I [master:272:crawl] GMaster: completed 44 crawls, 1 turns
>[2012-04-13 00:07:30.282547] E [repce:188:__call__] RepceClient: call 7967:139839447734016:1334290050.28 (set_xtime) failed on peer with OSError
>[2012-04-13 00:07:30.282946] E [syncdutils:184:log_raise_exception] <top>: FAIL: 
>Traceback (most recent call last):
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 115, in main
>    main_i()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 366, in main_i
>    local.service_loop(*[r for r in [remote] if r])
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/resource.py", line 740, in service_loop
>    GMaster(self, args[0]).crawl_loop()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 143, in crawl_loop
>    self.crawl()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 406, in crawl
>    self.wait(path, xtl)
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 167, in wait
>    ret = j[-1]()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 149, in <lambda>
>    self.jobtab[path].append((label, a, lambda : job(*a, **kw)))
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 167, in wait
>    ret = j[-1]()
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 149, in <lambda>
>    self.jobtab[path].append((label, a, lambda : job(*a, **kw)))
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 391, in regjob
>    self.sendmark(e, xte)
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/master.py", line 181, in sendmark
>    self.slave.server.set_xtime(path, self.uuid, mark)
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/repce.py", line 204, in __call__
>    return self.ins(self.meth, *a)
>  File "/usr/local/libexec/glusterfs/python/syncdaemon/repce.py", line 189, in __call__
>    raise res
>OSError: [Errno 2] No such file or directory
>[2012-04-13 00:07:30.353756] I [syncdutils:142:finalize] <top>: exiting.
>[2012-04-13 00:07:30.366086] I [monitor(monitor):21:set_state] Monitor: new state: faulty
>[2012-04-13 00:07:40.429970] I [monitor(monitor):80:monitor] Monitor: ------------------------------------------------------------
>[2012-04-13 00:07:40.430282] I [monitor(monitor):81:monitor] Monitor: starting gsyncd worker
>[2012-04-13 00:07:40.937973] I [gsyncd:355:main_i] <top>: syncing: gluster://localhost:master -> ssh://172.17.251.57::slave
>[2012-04-13 00:07:51.802118] I [master:284:crawl] GMaster: new master is 0477ea38-ae95-402d-aab6-411112557e82
>[2012-04-13 00:07:51.802546] I [master:288:crawl] GMaster: primary master with volume id 0477ea38-ae95-402d-aab6-411112557e82 ...
>[2012-04-13 00:08:17.470005] I [master:272:crawl] GMaster: completed 49 crawls, 2 turns
>[2012-04-13 00:08:40.517041] I [monitor(monitor):21:set_state] Monitor: new state: OK
>[2012-04-13 00:08:51.216768] I [master:272:crawl] GMaster: completed 58 crawls, 0 turns
>[2012-04-13 00:09:17.782604] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:09:51.516823] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:10:18.90781] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:10:52.272039] I [master:272:crawl] GMaster: completed 59 crawls, 1 turns
>[2012-04-13 00:11:18.769320] I [master:272:crawl] GMaster: completed 59 crawls, 1 turns
>[2012-04-13 00:11:53.95364] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-13 00:12:19.574902] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-13 00:12:53.937902] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-13 00:13:20.367995] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-13 00:13:54.915936] I [master:272:crawl] GMaster: completed 60 crawls, 0 turns
>[2012-04-13 00:14:20.526407] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:14:55.308109] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:15:20.887917] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:15:55.654019] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:16:21.209877] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:16:55.982182] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:17:21.536190] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:17:56.289659] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:18:21.853437] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:18:56.618817] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:19:22.183104] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:19:56.941823] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:20:22.488858] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:20:57.261234] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:21:22.815972] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:21:57.572695] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:22:23.135730] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:22:57.899185] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:23:23.456293] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:23:58.237447] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:24:23.789829] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:24:58.586561] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:25:24.142672] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:25:58.916310] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:26:24.475903] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:26:59.267369] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:27:24.826899] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:27:59.609275] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:28:25.181557] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:28:59.969830] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:29:25.549237] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:30:00.309894] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:30:25.862854] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:31:00.631191] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:31:26.198462] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:32:00.969223] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:32:26.547802] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:33:01.331497] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:33:26.892383] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:34:01.670202] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:34:27.227596] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:35:02.1585] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:35:27.565130] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:36:02.325877] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:36:27.888566] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:37:02.657888] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:37:28.220765] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:38:03.11641] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:38:28.569217] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:39:03.339889] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:39:28.907917] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:40:03.660145] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:40:29.216089] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:41:04.6342] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:41:29.580916] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:42:04.362212] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:42:29.909909] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:43:04.516005] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns
>[2012-04-13 00:43:30.38574] I [master:272:crawl] GMaster: completed 59 crawls, 0 turns

Actions: View

Attachments on bug 812314: 577299 | 577300