Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 851031 Details for
Bug 1054105
dist-geo-rep : gsyncd crashed because of failing to create brick status file.
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
Glusterd logs of the node where it happened.
etc-glusterfs-glusterd.vol.log (text/x-log), 166.96 KB, created by
Vijaykumar Koppad
on 2014-01-16 12:16:04 UTC
(
hide
)
Description:
Glusterd logs of the node where it happened.
Filename:
MIME Type:
Creator:
Vijaykumar Koppad
Created:
2014-01-16 12:16:04 UTC
Size:
166.96 KB
patch
obsolete
>[2014-01-13 13:53:34.883466] I [glusterd-handler.c:1073:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2014-01-13 13:53:34.885539] I [glusterd-handler.c:1073:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2014-01-15 10:30:21.323011] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-15 10:30:27.487156] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-15 10:30:36.648693] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh --volname=master --last=yes >[2014-01-15 10:30:36.674448] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh --volname=master --last=yes >[2014-01-15 10:30:36.674609] I [glusterd-utils.c:1059:glusterd_service_stop] 0-management: brick already stopped >[2014-01-15 10:30:36.674712] E [glusterd-utils.c:1363:glusterd_brick_unlink_socket_file] 0-management: Failed to remove /var/run/4d0371f1e49836112916cb4b56a12655.socket error: No such file or directory >[2014-01-15 10:30:37.774755] E [glusterd-utils.c:3829:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/717777d26964ac2c82e3f617721f8c36.socket error: Permission denied >[2014-01-15 10:30:37.775515] I [glusterd-utils.c:3863:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2014-01-15 10:30:37.775841] I [glusterd-utils.c:3868:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2014-01-15 10:30:37.776292] I [glusterd-utils.c:3873:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2014-01-15 10:30:37.776618] I [glusterd-utils.c:3878:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2014-01-15 10:30:37.776914] I [glusterd-utils.c:3883:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2014-01-15 10:30:37.777253] I [glusterd-utils.c:3888:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2014-01-15 10:30:38.777794] E [glusterd-utils.c:3829:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/d6ee8f01e4493f3e457be6c1b71951ce.socket error: No such file or directory >[2014-01-15 10:30:38.778413] I [glusterd-pmap.c:271:pmap_registry_remove] 0-pmap: removing brick /bricks/master_brick1 on port 49152 >[2014-01-15 10:30:39.147403] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=1 total=1 >[2014-01-15 10:30:39.147490] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=1 total=1 >[2014-01-15 10:30:39.147572] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-15 10:30:39.147594] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-15 10:30:39.147730] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-15 10:30:39.147758] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-15 10:37:26.552195] W [glusterfsd.c:1097:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x328d6e894d] (-->/lib64/libpthread.so.0() [0x328de07851] (-->/usr/sbin/glusterd(glusterfs_sigwaiter+0xcd) [0x4053cd]))) 0-: received signum (15), shutting down >[2014-01-15 10:37:26.564599] I [glusterfsd.c:2026:main] 0-glusterd: Started running glusterd version 3.4.0.57rhs (glusterd --xlator-option *.upgrade=on -N) >[2014-01-15 10:37:26.568970] I [graph.c:239:gf_add_cmdline_options] 0-management: adding option 'upgrade' for volume 'management' with value 'on' >[2014-01-15 10:37:26.569081] I [glusterd.c:1150:init] 0-management: Using /var/lib/glusterd as working directory >[2014-01-15 10:37:26.569186] I [rpcsvc.c:2058:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64 >[2014-01-15 10:37:26.587421] I [socket.c:3505:socket_init] 0-socket.management: SSL support is NOT enabled >[2014-01-15 10:37:26.587475] I [socket.c:3520:socket_init] 0-socket.management: using system polling thread >[2014-01-15 10:37:26.587652] E [rpc-transport.c:266:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.4.0.57rhs/rpc-transport/rdma.so: cannot open shared object file: No such file or directory >[2014-01-15 10:37:26.587678] W [rpc-transport.c:270:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine >[2014-01-15 10:37:26.587699] W [rpcsvc.c:1481:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2014-01-15 10:37:26.587740] I [rpcsvc.c:2058:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64 >[2014-01-15 10:37:26.587863] I [socket.c:3505:socket_init] 0-socket.management: SSL support is NOT enabled >[2014-01-15 10:37:26.587884] I [socket.c:3520:socket_init] 0-socket.management: using system polling thread >[2014-01-15 10:37:34.888794] I [glusterd-store.c:1406:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 2 >[2014-01-15 10:37:34.890514] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:34.892363] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:34.893828] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:34.893967] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:34.894069] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:34.894088] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 10:37:34.900928] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:34.901093] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:34.901574] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 10:37:34.907857] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:34.908489] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:34.908533] I [socket.c:3520:socket_init] 0-management: using system polling thread >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option upgrade on > 8: option transport.socket.read-fail-log off > 9: option transport.socket.keepalive-interval 2 > 10: option transport.socket.keepalive-time 10 > 11: option transport-type rdma > 12: option working-directory /var/lib/glusterd > 13: end-volume > 14: >+------------------------------------------------------------------------------+ >[2014-01-15 10:37:34.919120] W [glusterfsd.c:1099:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x328d6e894d] (-->/lib64/libpthread.so.0() [0x328de07851] (-->glusterd(glusterfs_sigwaiter+0xcd) [0x4052fd]))) 0-: received signum (15), shutting down >[2014-01-15 10:37:34.933879] I [glusterfsd.c:2026:main] 0-glusterd: Started running glusterd version 3.4.0.57rhs (glusterd) >[2014-01-15 10:37:34.939275] I [glusterd.c:1150:init] 0-management: Using /var/lib/glusterd as working directory >[2014-01-15 10:37:34.939419] I [rpcsvc.c:2058:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64 >[2014-01-15 10:37:34.947273] I [socket.c:3505:socket_init] 0-socket.management: SSL support is NOT enabled >[2014-01-15 10:37:34.947324] I [socket.c:3520:socket_init] 0-socket.management: using system polling thread >[2014-01-15 10:37:34.947488] E [rpc-transport.c:266:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.4.0.57rhs/rpc-transport/rdma.so: cannot open shared object file: No such file or directory >[2014-01-15 10:37:34.947527] W [rpc-transport.c:270:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine >[2014-01-15 10:37:34.947545] W [rpcsvc.c:1481:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2014-01-15 10:37:34.947584] I [rpcsvc.c:2058:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64 >[2014-01-15 10:37:34.947708] I [socket.c:3505:socket_init] 0-socket.management: SSL support is NOT enabled >[2014-01-15 10:37:34.947728] I [socket.c:3520:socket_init] 0-socket.management: using system polling thread >[2014-01-15 10:37:43.430428] I [glusterd-store.c:1406:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 2 >[2014-01-15 10:37:43.432041] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:43.433403] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:43.434910] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:43.435042] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:43.435175] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:43.435236] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 10:37:43.442030] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:43.442475] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:43.442510] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 10:37:43.448343] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:43.448430] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:43.448469] I [socket.c:3520:socket_init] 0-management: using system polling thread >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option transport.socket.read-fail-log off > 8: option transport.socket.keepalive-interval 2 > 9: option transport.socket.keepalive-time 10 > 10: option transport-type rdma > 11: option working-directory /var/lib/glusterd > 12: end-volume > 13: >+------------------------------------------------------------------------------+ >[2014-01-15 10:37:43.462634] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:43.463251] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:43.463673] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:43.863832] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:43.863913] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:43.863987] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:43.864206] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:37:43.864324] I [glusterd.c:140:glusterd_uuid_init] 0-management: retrieved UUID: 9fca4eac-cd15-4eba-a4da-241e149933a8 >[2014-01-15 10:37:44.013691] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:37:44.243786] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:37:44.600828] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:37:44.601171] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.29 (0), ret: 0 >[2014-01-15 10:37:44.956741] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:37:44.956807] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:37:44.956830] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:37:45.460540] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53, port: 0 >[2014-01-15 10:37:45.852417] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:45.852460] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:37:45.852471] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:37:45.852477] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:37:45.852484] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:37:45.852579] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40, port: 0 >[2014-01-15 10:37:46.062292] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:37:46.062442] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.40 (0), ret: 0 >[2014-01-15 10:37:46.148850] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:37:46.148874] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:37:46.148883] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:37:46.153308] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:37:46.153334] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:37:46.153343] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:37:46.153351] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:37:46.153360] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:37:46.153463] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:46.153502] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:46.153585] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.53 (0), ret: 0 >[2014-01-15 10:37:46.291607] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:37:46.291634] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:37:46.291651] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:37:46.401434] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:37:46.401468] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29, port: 0 >[2014-01-15 10:37:46.459419] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:37:46.459457] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:37:46.459467] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:37:46.459473] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:37:46.459481] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:37:46.459640] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:46.459662] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:37:46.459677] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:37:46.459691] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:46.459705] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:37:46.459718] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:37:46.519248] W [glusterfsd.c:1099:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x328d6e894d] (-->/lib64/libpthread.so.0() [0x328de07851] (-->glusterd(glusterfs_sigwaiter+0xcd) [0x4052fd]))) 0-: received signum (15), shutting down >[2014-01-15 10:37:46.637312] I [glusterfsd.c:2026:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.4.0.57rhs (/usr/sbin/glusterd --pid-file=/var/run/glusterd.pid) >[2014-01-15 10:37:46.642891] I [glusterd.c:1150:init] 0-management: Using /var/lib/glusterd as working directory >[2014-01-15 10:37:46.643027] I [rpcsvc.c:2058:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64 >[2014-01-15 10:37:46.650807] I [socket.c:3505:socket_init] 0-socket.management: SSL support is NOT enabled >[2014-01-15 10:37:46.650854] I [socket.c:3520:socket_init] 0-socket.management: using system polling thread >[2014-01-15 10:37:46.651639] C [rdma.c:4099:gf_rdma_init] 0-rpc-transport/rdma: Failed to get IB devices >[2014-01-15 10:37:46.651751] E [rdma.c:4990:init] 0-rdma.management: Failed to initialize IB Device >[2014-01-15 10:37:46.651771] E [rpc-transport.c:333:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed >[2014-01-15 10:37:46.651843] W [rpcsvc.c:1481:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2014-01-15 10:37:46.651891] I [rpcsvc.c:2058:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64 >[2014-01-15 10:37:46.652013] I [socket.c:3505:socket_init] 0-socket.management: SSL support is NOT enabled >[2014-01-15 10:37:46.652035] I [socket.c:3520:socket_init] 0-socket.management: using system polling thread >[2014-01-15 10:37:55.013345] I [glusterd-store.c:1406:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 2 >[2014-01-15 10:37:55.015151] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:55.016728] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:55.018226] I [glusterd-handler.c:2886:glusterd_friend_add] 0-management: connect returned 0 >[2014-01-15 10:37:55.018359] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:55.018454] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:55.018473] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 10:37:55.025364] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:55.025820] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:55.025852] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 10:37:55.031744] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 10:37:55.031830] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 10:37:55.031850] I [socket.c:3520:socket_init] 0-management: using system polling thread >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option transport.socket.read-fail-log off > 8: option transport.socket.keepalive-interval 2 > 9: option transport.socket.keepalive-time 10 > 10: option transport-type rdma > 11: option working-directory /var/lib/glusterd > 12: end-volume > 13: >+------------------------------------------------------------------------------+ >[2014-01-15 10:37:55.041568] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:55.042952] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:55.043312] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:55.043504] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:55.044414] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:55.450649] I [glusterd.c:140:glusterd_uuid_init] 0-management: retrieved UUID: 9fca4eac-cd15-4eba-a4da-241e149933a8 >[2014-01-15 10:37:56.058450] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:37:56.642407] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53, port: 0 >[2014-01-15 10:37:57.083030] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40, port: 0 >[2014-01-15 10:37:57.215666] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29, port: 0 >[2014-01-15 10:37:57.228624] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:57.228733] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:37:57.228797] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:37:57.228824] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:37:57.228853] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:37:57.230543] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:37:57.241200] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:57.241455] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.53 (0), ret: 0 >[2014-01-15 10:37:57.567506] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:37:57.567578] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:37:57.567602] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:37:57.917614] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:37:57.917707] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:37:57.917770] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:57.920567] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:37:57.997607] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:37:58.131112] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:37:58.131512] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.40 (0), ret: 0 >[2014-01-15 10:37:58.572634] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:37:58.572694] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:37:58.572716] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:37:58.938732] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:37:58.938990] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.29 (0), ret: 0 >[2014-01-15 10:37:59.010620] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:37:59.010692] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:37:59.010717] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:37:59.022827] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:37:59.022907] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:59.023008] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:37:59.023066] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:37:59.023119] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:37:59.023166] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:38:06.027306] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:06.027439] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:07.027640] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:12.698350] W [socket.c:522:__socket_rwv] 0-management: readv on 10.70.43.29:24007 failed (No data available) >[2014-01-15 10:38:23.037722] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:29.610155] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:29.611162] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:38:29.990572] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:29.990840] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.29 (0), ret: 0 >[2014-01-15 10:38:30.092798] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:38:30.092907] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:38:30.092936] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:38:30.093527] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:30.094601] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:30.282478] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:38:30.282563] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:38:30.282597] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:30.282631] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:30.437613] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:38:30.437714] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:38:30.437761] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:30.437789] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:30.437821] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:38:30.576052] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:38:30.576224] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:38:30.576257] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:30.576274] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:30.576292] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:38:31.845446] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:32.268345] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29, port: 0 >[2014-01-15 10:38:32.502678] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:32.502788] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:32.502809] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:32.502827] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:38:32.502847] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:38:32.684286] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:32.684402] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:32.684422] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:32.684441] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:38:32.684461] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:38:32.822242] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:32.822311] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:32.822330] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:32.822349] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:38:32.822369] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:38:36.338605] W [socket.c:522:__socket_rwv] 0-management: readv on 10.70.43.29:24007 failed (No data available) >[2014-01-15 10:38:41.039414] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:41.039537] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:45.241936] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:38:45.632963] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:46.541726] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:38:46.541831] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:38:46.541856] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:46.541873] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:46.541891] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:38:46.542300] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.29 (0), ret: 0 >[2014-01-15 10:38:46.985490] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:38:46.985565] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:38:46.985587] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:38:46.985840] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:46.986450] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:47.533130] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:38:47.533301] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:38:47.533330] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:47.533344] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:47.533361] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:38:47.533716] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:38:47.534079] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:47.534478] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:38:47.534726] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:47.534772] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:47.577600] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:48.213750] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:48.213878] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:48.213897] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:48.213915] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:38:48.213941] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:38:48.463668] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:48.463747] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:48.463765] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:48.463783] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:38:48.463802] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:38:48.478054] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29, port: 0 >[2014-01-15 10:38:48.554695] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:38:48.554783] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:38:48.554801] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:38:48.554819] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:38:48.554838] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:38:58.058072] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:58.058228] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:38:58.058249] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:20.005910] W [socket.c:522:__socket_rwv] 0-management: readv on 10.70.43.40:24007 failed (No data available) >[2014-01-15 10:39:30.070603] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:31.933646] W [socket.c:522:__socket_rwv] 0-management: readv on 10.70.43.40:24007 failed (Connection reset by peer) >[2014-01-15 10:39:31.934440] E [rpc-clnt.c:369:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x164) [0x7f9fa0258594] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xc3) [0x7f9fa02580d3] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x7f9fa0257fee]))) 0-management: forced unwinding frame type(GLUSTERD-DUMP) op(DUMP(1)) called at 2014-01-15 10:39:30.070590 (xid=0x13x) >[2014-01-15 10:39:31.934474] E [glusterd-handshake.c:1112:__glusterd_peer_dump_version_cbk] 0-: Error through RPC layer, retry again later >[2014-01-15 10:39:31.935004] E [rpc-clnt.c:369:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x164) [0x7f9fa0258594] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xc3) [0x7f9fa02580d3] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x7f9fa0257fee]))) 0-management: forced unwinding frame type(Glusterd PING) op(PING(1)) called at 2014-01-15 10:39:30.070727 (xid=0x14x) >[2014-01-15 10:39:31.935050] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:31.935077] W [glusterd-ping.c:317:glusterd_ping_cbk] 0-management: timer must have expired >[2014-01-15 10:39:33.077832] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:42.961057] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:43.774407] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40, port: 0 >[2014-01-15 10:39:44.190749] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:39:45.467495] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:39:45.467610] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:39:45.467630] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:39:45.467648] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:39:45.467668] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:39:47.012853] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:39:47.013172] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.40 (0), ret: 0 >[2014-01-15 10:39:47.173509] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:39:47.173574] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:39:47.173596] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:39:47.173868] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:47.174567] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:47.715744] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:39:47.715856] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 10:39:47.715908] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:47.715956] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:47.793116] W [socket.c:522:__socket_rwv] 0-management: readv on 10.70.43.53:24007 failed (No data available) >[2014-01-15 10:39:47.831313] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:39:47.831386] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:39:47.831410] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:39:47.831425] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:39:47.831473] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:39:49.774561] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:39:49.774670] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:39:49.774710] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:39:49.774727] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:39:49.774744] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:39:50.163334] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:39:53.080380] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:53.376434] W [socket.c:522:__socket_rwv] 0-management: readv on 10.70.43.40:24007 failed (No data available) >[2014-01-15 10:39:58.081477] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:39:58.088258] E [socket.c:2158:socket_connect_finish] 0-management: connection to 10.70.43.53:24007 failed (Connection refused) >[2014-01-15 10:40:04.100389] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:40:04.900501] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:40:04.900727] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 10:40:06.093516] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:40:06.093645] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:40:06.093669] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:40:06.093687] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 10:40:06.093708] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:40:08.192606] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:40:08.192962] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.40 (0), ret: 0 >[2014-01-15 10:40:08.687515] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 10:40:08.687592] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 10:40:08.687616] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 10:40:08.687866] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:40:09.001715] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 10:40:09.001833] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:40:09.622316] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:40:10.395520] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:40:10.395630] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:40:10.395656] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:40:10.395671] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:40:10.395689] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:40:10.936602] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40, port: 0 >[2014-01-15 10:40:11.409454] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 10:40:11.409614] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 10:40:11.409663] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 10:40:11.409693] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 10:40:11.409729] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 10:40:15.124769] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 10:40:19.132047] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:27:22.453508] W [socket.c:522:__socket_rwv] 0-management: readv on 10.70.43.29:24007 failed (No data available) >[2014-01-15 12:27:33.905780] E [socket.c:2158:socket_connect_finish] 0-management: connection to 10.70.43.29:24007 failed (Connection refused) >[2014-01-15 12:29:57.544355] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:30:02.942180] W [socket.c:522:__socket_rwv] 0-management: readv on 10.70.43.29:24007 failed (Connection reset by peer) >[2014-01-15 12:30:02.942434] E [rpc-clnt.c:369:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x164) [0x7f9fa0258594] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xc3) [0x7f9fa02580d3] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x7f9fa0257fee]))) 0-management: forced unwinding frame type(GLUSTERD-DUMP) op(DUMP(1)) called at 2014-01-15 12:29:57.544335 (xid=0x24x) >[2014-01-15 12:30:02.942478] E [glusterd-handshake.c:1112:__glusterd_peer_dump_version_cbk] 0-: Error through RPC layer, retry again later >[2014-01-15 12:30:02.942574] E [rpc-clnt.c:369:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x164) [0x7f9fa0258594] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xc3) [0x7f9fa02580d3] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x7f9fa0257fee]))) 0-management: forced unwinding frame type(Glusterd PING) op(PING(1)) called at 2014-01-15 12:29:57.544685 (xid=0x25x) >[2014-01-15 12:30:02.942600] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:30:02.942623] W [glusterd-ping.c:317:glusterd_ping_cbk] 0-management: timer must have expired >[2014-01-15 12:30:13.584398] E [socket.c:2158:socket_connect_finish] 0-management: connection to 10.70.43.29:24007 failed (Connection refused) >[2014-01-15 12:31:28.910552] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:31:36.723508] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 12:31:36.839623] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:31:37.123657] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 12:31:37.124017] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.29 (0), ret: 0 >[2014-01-15 12:31:37.204564] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 12:31:37.204633] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 12:31:37.204657] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 12:31:37.205114] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:31:37.324476] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 12:31:37.583446] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:31:37.583604] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 12:31:37.583661] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 12:31:37.583683] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 12:31:37.583718] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 12:31:37.583736] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 12:31:37.689411] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 12:31:37.742246] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29, port: 0 >[2014-01-15 12:31:37.811779] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 12:31:37.811876] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 12:31:37.811914] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 12:31:37.811952] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 12:31:37.811993] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 12:31:37.917257] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 12:31:37.917354] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 12:31:37.917422] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 12:31:37.917465] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 12:31:37.917489] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 12:31:46.949873] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:31:47.956248] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:04.997940] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:11.778223] I [glusterd-handshake.c:562:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 2 >[2014-01-15 12:32:11.966791] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:12.350443] I [glusterd-handler.c:2028:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 12:32:12.350768] I [glusterd-handler.c:3059:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.70.43.53 (0), ret: 0 >[2014-01-15 12:32:12.626407] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, host: 10.70.43.29 >[2014-01-15 12:32:12.626470] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, host: 10.70.43.40 >[2014-01-15 12:32:12.626492] I [glusterd-sm.c:495:glusterd_ac_send_friend_update] 0-: Added uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53 >[2014-01-15 12:32:12.626774] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:12.627444] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:12.860741] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 12:32:12.861438] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 12:32:12.861484] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 12:32:12.861507] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 12:32:12.861528] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 12:32:12.862178] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce >[2014-01-15 12:32:12.862608] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:12.862701] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 12:32:12.862743] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 12:32:12.862758] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 12:32:12.862775] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 12:32:12.862792] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, hostname:10.70.43.53 >[2014-01-15 12:32:12.943680] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc >[2014-01-15 12:32:13.046271] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:13.498542] I [glusterd-rpc-ops.c:554:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 12:32:13.601563] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 12:32:13.601668] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 12:32:13.601692] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 12:32:13.601706] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 12:32:13.601723] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 12:32:13.838538] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 12:32:13.838633] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 12:32:13.838657] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 12:32:13.838673] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 12:32:13.838690] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 12:32:13.956143] I [glusterd-rpc-ops.c:357:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8, host: 10.70.43.53, port: 0 >[2014-01-15 12:32:14.224463] I [glusterd-handler.c:2190:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 6da10c8a-638d-452d-b7cb-e0bcd1533fa8 >[2014-01-15 12:32:14.224556] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: fdfdff94-3084-4aa2-8dcc-1c20f59891ce, hostname:10.70.43.40 >[2014-01-15 12:32:14.224598] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, hostname:10.70.43.0 >[2014-01-15 12:32:14.224614] I [glusterd-handler.c:2244:__glusterd_handle_friend_update] 0-: Received my uuid as Friend >[2014-01-15 12:32:14.224631] I [glusterd-handler.c:2235:__glusterd_handle_friend_update] 0-: Received uuid: 762459aa-41b9-4a83-a922-821c7be1c8fc, hostname:10.70.43.29 >[2014-01-15 12:32:22.000004] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:23.000327] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:24.000593] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:39.123025] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:39.123462] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:39.123825] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:39.125170] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:39.125310] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:39.126148] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:43.505666] I [glusterd-pmap.c:227:pmap_registry_bind] 0-pmap: adding brick /bricks/master_brick1 on port 49152 >[2014-01-15 12:32:43.507566] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 12:32:43.507675] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 12:32:43.507698] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 12:32:43.715845] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 12:32:43.716019] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 12:32:43.716061] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 12:32:43.729158] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 12:32:43.729325] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 12:32:43.729352] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 12:32:43.746613] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=master --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2014-01-15 12:32:43.755927] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-15 12:32:43.756010] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-15 12:32:43.846428] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=master --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2014-01-15 12:32:50.006161] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:50.006266] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:32:50.006284] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:12.921118] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:12.921520] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:12.921898] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:12.924328] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:12.924392] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:12.924436] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:19.746343] I [glusterd-geo-rep.c:1598:glusterd_get_statefile_name] 0-: Using default config template(/var/lib/glusterd/geo-replication/gsyncd_template.conf). >[2014-01-15 12:33:23.019239] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:23.019319] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:23.019339] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:30.606570] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:30.606935] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:30.610810] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:30.612060] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:30.613117] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:30.618588] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:30.632019] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/gsync-create/post/S56glusterd-geo-rep-create-post.sh --volname=master is_push_pem=0 pub_file=/var/lib/glusterd/geo-replication/common_secret.pem.pub slave_ip=10.70.43.76 >[2014-01-15 12:33:41.027229] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.027290] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.027307] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.078864] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.079234] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.079539] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.081468] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.082394] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.082444] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:41.414243] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-15 12:33:44.077437] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-15 12:33:44.077498] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-15 12:33:45.079271] E [glusterd-utils.c:4007:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/717777d26964ac2c82e3f617721f8c36.socket error: Permission denied >[2014-01-15 12:33:45.079830] I [glusterd-utils.c:4041:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2014-01-15 12:33:45.080138] I [glusterd-utils.c:4046:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2014-01-15 12:33:45.080485] I [glusterd-utils.c:4051:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2014-01-15 12:33:45.080771] I [glusterd-utils.c:4056:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2014-01-15 12:33:45.081058] I [glusterd-utils.c:4061:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2014-01-15 12:33:45.081410] I [glusterd-utils.c:4066:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2014-01-15 12:33:45.089228] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 12:33:45.089355] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 12:33:45.089376] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 12:33:46.090712] E [glusterd-utils.c:4007:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/d6ee8f01e4493f3e457be6c1b71951ce.socket error: No such file or directory >[2014-01-15 12:33:46.104161] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-15 12:33:46.104331] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-15 12:33:46.104355] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-15 12:33:46.436215] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-15 12:33:46.436391] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-15 12:33:46.436423] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-15 12:33:46.436609] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-15 12:33:47.595565] I [glusterd-handler.c:1073:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2014-01-15 12:33:52.030331] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:52.030642] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:52.030820] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:53.070513] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:53.279261] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:33:53.315469] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.033244] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.033351] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.033370] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.515363] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.515863] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.516436] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.518356] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.519039] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:04.519110] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:15.035444] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:15.035555] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:34:15.035575] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-15 12:40:21.295006] I [glusterd-handler.c:1073:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2014-01-15 12:40:21.296826] I [glusterd-handler.c:1073:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2014-01-16 09:51:35.861739] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:35.862121] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:35.862495] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:35.864690] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:35.864761] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:35.866522] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:36.196004] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-16 09:51:42.123709] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-16 09:51:46.408043] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:46.408143] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:46.408178] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:46.451854] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:46.452176] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:46.452417] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:46.455432] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:46.457897] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:46.458852] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:50.922406] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:50.936484] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh --volname=master --last=yes >[2014-01-16 09:51:50.965120] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh --volname=master --last=yes >[2014-01-16 09:51:50.965310] I [glusterd-utils.c:1101:glusterd_service_stop] 0-management: brick already stopped >[2014-01-16 09:51:50.965564] E [glusterd-utils.c:1417:glusterd_brick_unlink_socket_file] 0-management: Failed to remove /var/run/4d0371f1e49836112916cb4b56a12655.socket error: No such file or directory >[2014-01-16 09:51:52.606719] E [glusterd-utils.c:4007:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/717777d26964ac2c82e3f617721f8c36.socket error: Permission denied >[2014-01-16 09:51:52.607332] I [glusterd-utils.c:4041:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2014-01-16 09:51:52.607644] I [glusterd-utils.c:4046:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2014-01-16 09:51:52.607937] I [glusterd-utils.c:4051:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2014-01-16 09:51:52.608261] I [glusterd-utils.c:4056:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2014-01-16 09:51:52.608622] I [glusterd-utils.c:4061:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2014-01-16 09:51:52.608930] I [glusterd-utils.c:4066:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2014-01-16 09:51:53.609430] E [glusterd-utils.c:4007:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/d6ee8f01e4493f3e457be6c1b71951ce.socket error: No such file or directory >[2014-01-16 09:51:53.610468] I [glusterd-pmap.c:271:pmap_registry_remove] 0-pmap: removing brick /bricks/master_brick1 on port 49152 >[2014-01-16 09:51:53.617160] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=1 total=1 >[2014-01-16 09:51:53.617287] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=1 total=1 >[2014-01-16 09:51:53.617380] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-16 09:51:53.617405] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-16 09:51:53.617521] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-16 09:51:53.617547] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-16 09:51:57.409802] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:57.410179] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:57.410317] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:58.226874] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:58.734625] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:51:58.749849] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:52:08.412011] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:52:09.412253] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:52:09.412342] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:34.533272] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:34.533651] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:34.533952] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:34.535705] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:34.536901] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:34.536954] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:38.813512] I [glusterd-pmap.c:227:pmap_registry_bind] 0-pmap: adding brick /bricks/master_brick1 on port 49153 >[2014-01-16 09:58:38.815310] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-16 09:58:38.815452] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-16 09:58:38.815479] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-16 09:58:38.875982] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-16 09:58:38.876110] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-16 09:58:38.876134] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-16 09:58:38.889237] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-16 09:58:38.889359] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-16 09:58:38.889382] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-16 09:58:38.897429] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-16 09:58:38.897497] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-16 09:58:38.916472] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=master --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2014-01-16 09:58:39.010545] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=master --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2014-01-16 09:58:45.480559] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:45.480666] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:58:45.480712] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:04.144536] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:04.144889] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:04.145288] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:04.148208] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:04.148282] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:04.148315] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:10.213110] I [glusterd-geo-rep.c:1598:glusterd_get_statefile_name] 0-: Using default config template(/var/lib/glusterd/geo-replication/gsyncd_template.conf). >[2014-01-16 09:59:14.486275] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:14.486349] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:14.486371] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:21.391121] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:21.394788] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:21.395374] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:21.395803] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:21.398317] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:21.398799] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:21.411054] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/gsync-create/post/S56glusterd-geo-rep-create-post.sh --volname=master is_push_pem=0 pub_file=/var/lib/glusterd/geo-replication/common_secret.pem.pub slave_ip=10.70.43.76 >[2014-01-16 09:59:31.282798] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-16 09:59:31.495382] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:31.495462] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:31.495483] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:32.596778] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:32.597116] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:32.597354] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:32.598998] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:32.599773] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:32.599837] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:35.587257] E [glusterd-utils.c:4007:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/717777d26964ac2c82e3f617721f8c36.socket error: Permission denied >[2014-01-16 09:59:35.587756] I [glusterd-utils.c:4041:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2014-01-16 09:59:35.588087] I [glusterd-utils.c:4046:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2014-01-16 09:59:35.588439] I [glusterd-utils.c:4051:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2014-01-16 09:59:35.588729] I [glusterd-utils.c:4056:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2014-01-16 09:59:35.589013] I [glusterd-utils.c:4061:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2014-01-16 09:59:35.589347] I [glusterd-utils.c:4066:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2014-01-16 09:59:35.602717] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-16 09:59:35.602880] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-16 09:59:35.602916] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-16 09:59:36.604739] E [glusterd-utils.c:4007:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/d6ee8f01e4493f3e457be6c1b71951ce.socket error: No such file or directory >[2014-01-16 09:59:36.617278] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-16 09:59:36.617410] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-16 09:59:36.617433] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-16 09:59:36.960253] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-16 09:59:36.960317] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-16 09:59:36.960370] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-16 09:59:36.960420] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-16 09:59:36.960451] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-16 09:59:36.960523] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-16 09:59:38.053346] I [glusterd-handler.c:1073:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2014-01-16 09:59:43.499548] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:43.499964] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:43.500157] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:43.520047] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:43.534557] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:43.542575] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.502271] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.502380] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.502418] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.751548] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.751885] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.752219] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.753928] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.756037] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 09:59:54.756200] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:00:05.504092] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:00:05.504279] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:00:05.504300] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:21.029611] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:21.029992] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:21.030247] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:21.031741] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:21.032408] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:21.034795] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:31.537840] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:31.537922] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:31.537983] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:59.386083] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:59.386470] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:59.386983] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:59.389252] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:59.389736] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:02:59.389949] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:09.546538] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:09.546837] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:09.547016] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:09.548471] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:09.548609] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:09.548655] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:19.549706] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:19.550028] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:19.550194] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:19.551829] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:19.552401] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:19.555368] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:29.566653] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:29.567076] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:29.567292] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:29.568810] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:29.568891] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:29.568925] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:39.587499] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:39.587774] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:39.588024] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:39.589533] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:39.589810] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:39.591062] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.599656] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.599731] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.599750] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.892751] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.893105] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.893359] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.896529] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.898316] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:03:49.900006] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:00.603500] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:00.603824] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:00.604020] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:00.605688] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:00.605761] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:00.605792] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.608149] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.608270] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.608304] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.943536] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.943846] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.944335] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.946106] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.946785] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:10.947241] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:21.613424] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:21.613528] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:21.613551] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:22.203529] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:22.204055] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:22.204640] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:22.208645] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:22.211484] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:22.211576] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:30.183587] I [socket.c:3106:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1) >[2014-01-16 10:04:30.183633] E [rpcsvc.c:1204:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x1x, Program: GlusterD svc cli, ProgVers: 2, Proc: 22) to rpc-transport (socket.management) >[2014-01-16 10:04:30.183667] E [glusterd-utils.c:405:glusterd_submit_reply] 0-: Reply submission failed >[2014-01-16 10:04:32.620560] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:32.620659] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:32.620677] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:42.074279] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:42.074601] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:42.074818] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:42.076809] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:42.076904] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:42.077425] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:42.410951] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-16 10:04:52.624216] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:52.624536] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:52.624736] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:52.626392] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:52.626472] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:04:52.626505] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:05:02.628262] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:05:02.628350] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:05:02.628372] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:42.149236] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:42.149489] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:42.149701] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:42.152055] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:42.152125] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:42.152157] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:52.262975] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:52.263198] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:52.263330] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:52.264870] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:52.265341] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:57:52.266304] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:02.102411] I [socket.c:3106:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1) >[2014-01-16 10:58:02.102478] E [rpcsvc.c:1204:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x1x, Program: GlusterD svc cli, ProgVers: 2, Proc: 22) to rpc-transport (socket.management) >[2014-01-16 10:58:02.102532] E [glusterd-utils.c:405:glusterd_submit_reply] 0-: Reply submission failed >[2014-01-16 10:58:02.266899] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:02.266997] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:02.267017] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:03.997186] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:03.997566] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:03.997693] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:03.999366] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:03.999820] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:04.003502] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:04.408289] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-16 10:58:14.281272] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:14.281381] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:14.281450] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:14.282747] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:14.282867] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:14.284046] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.294326] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.294408] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.294430] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.631624] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.631916] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.632203] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.634913] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.636489] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:24.637643] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:35.305515] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:35.305788] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:35.306246] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:35.307868] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:35.308014] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:35.309558] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.314988] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.315282] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.315314] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.537216] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.537492] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.537800] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.541140] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.541283] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:45.542481] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.325672] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.325757] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.325777] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.605113] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.605551] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.605828] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.607675] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.609408] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:58:56.609534] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.334279] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.334359] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.334381] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.681307] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.681619] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.681869] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.684671] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.685047] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:07.687712] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.337533] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.337621] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.337640] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.559354] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.559749] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.560137] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.561462] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.562660] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:18.564136] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:20.692333] I [socket.c:3106:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1) >[2014-01-16 10:59:20.692427] E [rpcsvc.c:1204:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x1x, Program: GlusterD svc cli, ProgVers: 2, Proc: 22) to rpc-transport (socket.management) >[2014-01-16 10:59:20.692483] E [glusterd-utils.c:405:glusterd_submit_reply] 0-: Reply submission failed >[2014-01-16 10:59:26.517796] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_10.70.43.76_slave/gsyncd.conf). >[2014-01-16 10:59:29.340525] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:29.340616] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:29.340633] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:30.506677] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:30.506973] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:30.507222] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:30.510036] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:30.510233] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:30.510295] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.344039] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.344129] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.344151] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.634741] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.635072] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.636006] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.639125] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.641046] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:41.645293] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.348173] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.348262] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.348281] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.480667] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.481033] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.481372] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.483408] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.484331] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 10:59:52.484385] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.351271] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.351374] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.351394] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.588379] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.589150] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.590029] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.591989] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.595553] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:03.596043] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.356626] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.356715] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.356736] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.441261] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.441785] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.442392] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.444959] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.445042] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:14.445078] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.363202] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.363285] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.363307] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.695655] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.696456] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.697116] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.700534] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.704519] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:25.706015] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.367029] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.367097] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.367115] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.679309] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.679570] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.679779] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.682702] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.683228] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:36.683301] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.373142] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.373216] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.373237] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.828667] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.829019] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.829291] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.833257] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.833352] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:47.835350] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:58.392484] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:58.392912] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:58.393579] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:58.394710] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:58.394792] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:00:58.396343] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.398177] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.398277] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.398307] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.604946] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.605522] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.606062] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.608284] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.608420] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:08.610020] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.415034] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.415108] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.415129] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.831595] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.831879] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.832163] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.835143] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.838040] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:19.839428] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:30.419437] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:30.419758] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:30.419935] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:30.420791] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:30.421122] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:30.421663] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.422320] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.422389] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.422429] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.763098] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.763656] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.764020] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.765773] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.768063] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:40.768238] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:51.433567] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:51.433865] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:51.434039] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:51.435668] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:51.435769] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:01:51.436217] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:01.436322] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:01.436606] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:01.436756] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:01.438355] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:01.438437] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:01.438471] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.443096] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.443193] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.443215] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.986456] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.986835] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.987538] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.990486] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.990580] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:11.994330] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.448476] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.448551] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.448568] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.751061] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.751458] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.751765] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.753661] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.754486] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:22.754552] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.459286] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.459391] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.459413] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.974373] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.974930] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.975568] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.978285] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.981053] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:33.982370] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.471239] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.471306] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.471325] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.798398] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.798708] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.798924] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.800955] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.801687] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:44.801743] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.480274] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.480380] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.480404] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.775080] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.775369] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.775681] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.778986] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.780057] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:02:55.780135] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.488403] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.488481] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.488500] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.588244] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.588519] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.588741] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.590633] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.592561] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:06.592629] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.492036] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.492123] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.492147] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.797742] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.798079] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.798341] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.801244] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.805407] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:17.805891] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.499200] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.499308] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.499326] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.657439] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.657757] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.658039] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.660835] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.660964] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:28.661001] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.504016] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.504102] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.504122] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.895683] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.895993] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.896283] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.899392] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.899848] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:39.902167] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:50.507246] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:50.507636] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:50.507837] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:50.510120] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:50.510333] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:03:50.510400] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:00.511344] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:00.511699] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:00.511890] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:00.513827] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:00.513964] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:00.516113] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:10.515073] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:10.515148] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:10.779365] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:10.779849] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:10.781987] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:10.783865] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:11.517109] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:12.147841] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:12.154291] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:21.520259] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:21.520351] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:21.903574] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:21.904537] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:21.907025] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:21.911840] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:22.520581] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:22.522288] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.524202] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.524317] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.524363] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.790434] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.790776] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.791048] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.793850] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.794129] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:32.794240] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.533349] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.533437] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.533474] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.883691] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.884043] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.884296] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.887449] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.890414] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:43.891351] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.537022] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.537099] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.537117] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.789638] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.789985] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.790344] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.792177] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.792896] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:04:54.792944] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.558203] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.558282] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.558302] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.866420] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.866799] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.867118] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.869946] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.873591] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:05.874496] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:13.814484] I [socket.c:3106:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1) >[2014-01-16 11:05:13.814560] E [rpcsvc.c:1204:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x1x, Program: GlusterD svc cli, ProgVers: 2, Proc: 22) to rpc-transport (socket.management) >[2014-01-16 11:05:13.814596] E [glusterd-utils.c:405:glusterd_submit_reply] 0-: Reply submission failed >[2014-01-16 11:05:16.561995] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:16.562108] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:05:16.562127] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:01.699318] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:01.699638] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:01.699901] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:01.702024] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:01.703479] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:01.703578] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:06.697891] I [glusterd-pmap.c:227:pmap_registry_bind] 0-pmap: adding brick /bricks/master_dist_brick1 on port 49154 >[2014-01-16 11:16:06.700720] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-16 11:16:06.700847] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-16 11:16:06.700869] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-16 11:16:07.778283] E [glusterd-utils.c:4007:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/717777d26964ac2c82e3f617721f8c36.socket error: Permission denied >[2014-01-16 11:16:07.778828] I [glusterd-utils.c:4041:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2014-01-16 11:16:07.779159] I [glusterd-utils.c:4046:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2014-01-16 11:16:07.779490] I [glusterd-utils.c:4051:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2014-01-16 11:16:07.779777] I [glusterd-utils.c:4056:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2014-01-16 11:16:07.780083] I [glusterd-utils.c:4061:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2014-01-16 11:16:07.780402] I [glusterd-utils.c:4066:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2014-01-16 11:16:07.793286] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-16 11:16:07.793417] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-16 11:16:07.793439] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-16 11:16:07.802940] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=master_dist --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2014-01-16 11:16:07.804161] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-16 11:16:07.804269] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-16 11:16:07.804413] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-16 11:16:07.852013] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=master_dist --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2014-01-16 11:16:12.690344] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:12.690417] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:12.690462] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:54.049118] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:54.049382] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:54.049583] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:54.051040] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:54.054101] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:16:54.054229] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:00.568263] I [glusterd-geo-rep.c:1598:glusterd_get_statefile_name] 0-: Using default config template(/var/lib/glusterd/geo-replication/gsyncd_template.conf). >[2014-01-16 11:17:04.700192] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:04.700325] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:04.700349] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:11.569516] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:11.570746] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:11.571049] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:11.575726] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:11.579515] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:11.579600] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:11.591826] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/gsync-create/post/S56glusterd-geo-rep-create-post.sh --volname=master_dist is_push_pem=0 pub_file=/var/lib/glusterd/geo-replication/common_secret.pem.pub slave_ip=10.70.43.76 >[2014-01-16 11:17:21.706054] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:21.706440] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:21.706695] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:21.707521] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:21.708289] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:21.708343] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:24.987446] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_dist_10.70.43.76_slave_repl/gsyncd.conf). >[2014-01-16 11:17:29.356374] E [glusterd-utils.c:4007:glusterd_nodesvc_unlink_socket_file] 0-management: Failed to remove /var/run/717777d26964ac2c82e3f617721f8c36.socket error: Permission denied >[2014-01-16 11:17:29.356899] I [glusterd-utils.c:4041:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2014-01-16 11:17:29.357280] I [glusterd-utils.c:4046:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2014-01-16 11:17:29.357578] I [glusterd-utils.c:4051:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2014-01-16 11:17:29.357870] I [glusterd-utils.c:4056:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2014-01-16 11:17:29.358213] I [glusterd-utils.c:4061:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2014-01-16 11:17:29.358505] I [glusterd-utils.c:4066:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2014-01-16 11:17:29.364941] I [rpc-clnt.c:977:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2014-01-16 11:17:29.365066] I [socket.c:3505:socket_init] 0-management: SSL support is NOT enabled >[2014-01-16 11:17:29.365087] I [socket.c:3520:socket_init] 0-management: using system polling thread >[2014-01-16 11:17:29.706357] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=2236 max=0 total=0 >[2014-01-16 11:17:29.706411] I [mem-pool.c:539:mem_pool_destroy] 0-management: size=124 max=0 total=0 >[2014-01-16 11:17:29.706468] I [socket.c:2235:socket_event_handler] 0-transport: disconnecting now >[2014-01-16 11:17:30.885943] I [glusterd-handler.c:1073:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2014-01-16 11:17:31.720265] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:31.720567] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:31.720742] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:35.491696] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:35.508598] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:35.513366] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:44.965857] I [glusterd-geo-rep.c:282:__glusterd_handle_gsync_set] 0-management: master not found, while handling geo-replication options >[2014-01-16 11:17:44.965917] I [glusterd-geo-rep.c:289:__glusterd_handle_gsync_set] 0-management: slave not found, while handling geo-replication options >[2014-01-16 11:17:44.968890] W [glusterd-geo-rep.c:1421:glusterd_op_gsync_args_get] 0-: master not found >[2014-01-16 11:17:45.724290] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:45.724376] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:45.724397] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:47.015100] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:47.015310] E [glusterd-utils.c:149:glusterd_lock] 0-management: Unable to get lock for uuid: 9fca4eac-cd15-4eba-a4da-241e149933a8, lock held by: 9fca4eac-cd15-4eba-a4da-241e149933a8 >[2014-01-16 11:17:47.015573] E [glusterd-syncop.c:1217:gd_sync_task_begin] 0-management: Unable to acquire lock >[2014-01-16 11:17:47.015981] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:47.016335] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:47.018160] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:47.019109] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:47.020788] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:57.727153] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:57.727300] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:17:57.727321] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:04.659250] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:04.659523] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:04.659729] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:04.661980] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:04.662100] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:04.662374] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:05.012974] I [glusterd-geo-rep.c:1598:glusterd_get_statefile_name] 0-: Using default config template(/var/lib/glusterd/geo-replication/gsyncd_template.conf). >[2014-01-16 11:18:05.349620] E [glusterd-geo-rep.c:2145:glusterd_op_stage_gsync_set] 0-: Geo-replication session between master_dist and 10.70.43.174::slave_repl does not exist.. statefile = /var/lib/glusterd/geo-replication/master_dist_10.70.43.174_slave_repl/ssh%3A%2F%2Froot%4010.70.43.174%3Agluster%3A%2F%2F127.0.0.1%3Aslave_repl.status >[2014-01-16 11:18:05.349704] E [glusterd-syncop.c:904:gd_stage_op_phase] 0-management: Staging of operation 'Volume Geo-replication' failed on localhost : Geo-replication session between master_dist and 10.70.43.174::slave_repl does not exist. >[2014-01-16 11:18:10.996889] I [glusterd-geo-rep.c:282:__glusterd_handle_gsync_set] 0-management: master not found, while handling geo-replication options >[2014-01-16 11:18:10.996982] I [glusterd-geo-rep.c:289:__glusterd_handle_gsync_set] 0-management: slave not found, while handling geo-replication options >[2014-01-16 11:18:10.999858] W [glusterd-geo-rep.c:1421:glusterd_op_gsync_args_get] 0-: master not found >[2014-01-16 11:18:14.733645] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:14.734009] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:14.734279] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:14.735368] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:14.736114] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:14.736212] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:17.960323] I [glusterd-geo-rep.c:1598:glusterd_get_statefile_name] 0-: Using default config template(/var/lib/glusterd/geo-replication/gsyncd_template.conf). >[2014-01-16 11:18:18.304221] E [glusterd-geo-rep.c:2145:glusterd_op_stage_gsync_set] 0-: Geo-replication session between master_dist and 10.70.43.174::slave_repl does not exist.. statefile = /var/lib/glusterd/geo-replication/master_dist_10.70.43.174_slave_repl/ssh%3A%2F%2Froot%4010.70.43.174%3Agluster%3A%2F%2F127.0.0.1%3Aslave_repl.status >[2014-01-16 11:18:18.304300] E [glusterd-syncop.c:904:gd_stage_op_phase] 0-management: Staging of operation 'Volume Geo-replication' failed on localhost : Geo-replication session between master_dist and 10.70.43.174::slave_repl does not exist. >[2014-01-16 11:18:20.591087] I [glusterd-geo-rep.c:282:__glusterd_handle_gsync_set] 0-management: master not found, while handling geo-replication options >[2014-01-16 11:18:20.591155] I [glusterd-geo-rep.c:289:__glusterd_handle_gsync_set] 0-management: slave not found, while handling geo-replication options >[2014-01-16 11:18:20.593775] W [glusterd-geo-rep.c:1421:glusterd_op_gsync_args_get] 0-: master not found >[2014-01-16 11:18:24.737186] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:24.737324] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:24.737519] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:24.739322] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:24.739891] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:24.764683] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:24.768229] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:33.678810] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_dist_10.70.43.76_slave_repl/gsyncd.conf). >[2014-01-16 11:18:34.744209] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:34.744516] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:34.746106] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:34.746531] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:35.746999] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:37.465814] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:37.469337] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:43.177052] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_dist_10.70.43.76_slave_repl/gsyncd.conf). >[2014-01-16 11:18:44.749644] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:44.750007] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:44.752047] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:44.752239] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:47.751242] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:47.752831] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:54.752778] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:54.752861] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:18:57.753373] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:19:55.438512] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:19:55.438784] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:19:55.439036] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:19:55.441419] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:19:55.441543] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:19:55.441863] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:01.381238] I [glusterd-geo-rep.c:1598:glusterd_get_statefile_name] 0-: Using default config template(/var/lib/glusterd/geo-replication/gsyncd_template.conf). >[2014-01-16 11:20:05.777455] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:05.777533] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:05.777554] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:12.669747] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:12.670500] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:12.672832] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:12.674099] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:12.677775] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:12.680241] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:12.690712] I [run.c:190:runner_log] 0-management: Ran script: /var/lib/glusterd/hooks/1/gsync-create/post/S56glusterd-geo-rep-create-post.sh --volname=master_dist is_push_pem=0 pub_file=/var/lib/glusterd/geo-replication/common_secret.pem.pub slave_ip=10.70.43.76 >[2014-01-16 11:20:22.781566] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:22.781814] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:22.781988] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:22.783125] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:22.783235] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:23.587399] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:23.592412] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:32.783966] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:32.784057] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:20:33.784290] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:00.414113] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:00.414455] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:00.414761] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:00.417840] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:00.418671] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:00.418752] I [glusterd-ping.c:297:glusterd_ping_cbk] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:00.761744] I [glusterd-geo-rep.c:1590:glusterd_get_statefile_name] 0-: Using passed config template(/var/lib/glusterd/geo-replication/master_dist_10.70.43.76_slave_repl/gsyncd.conf). >[2014-01-16 11:21:05.382813] I [glusterd-handler.c:1073:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2014-01-16 11:21:10.792849] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:10.793017] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s >[2014-01-16 11:21:10.793054] I [glusterd-ping.c:181:glusterd_start_ping] 0-management: defaulting ping-timeout to 10s
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1054105
: 851031