Attachment 1044665 Details for Bug 1222065 – glusterfs log node01

glusterfs log node01

etc-glusterfs-glusterd.vol.log-20150628 (text/plain), 165.99 KB, created by Anatoly Pugachev on 2015-06-30 11:22:36 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Anatoly Pugachev

Created: 2015-06-30 11:22:36 UTC

Size: 165.99 KB

patch

obsolete

>[2015-06-21 08:35:46.919748] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-21 08:35:46.919822] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-21 08:35:46.960755] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-21 08:35:46.960793] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-21 08:35:46.962887] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-21 08:35:46.963032] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-21 08:35:46.963174] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-21 08:35:46.963314] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-21 08:38:13.109187] W [socket.c:642:__socket_rwv] 0-management: readv on 192.168.136.105:24007 failed (No data available)
>[2015-06-21 08:38:13.109419] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd.
>[2015-06-21 08:38:15.612407] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down
>[2015-06-21 08:38:44.717594] I [MSGID: 100030] [glusterfsd.c:2294:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.1 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid)
>[2015-06-21 08:38:44.915195] I [glusterd.c:1282:init] 0-management: Maximum allowed open file descriptors set to 65536
>[2015-06-21 08:38:44.915230] I [glusterd.c:1327:init] 0-management: Using /var/lib/glusterd as working directory
>[2015-06-21 08:38:45.023287] W [rdma.c:4493:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device)
>[2015-06-21 08:38:45.023310] W [rdma.c:4793:init] 0-rdma.management: Failed to initialize IB Device
>[2015-06-21 08:38:45.023319] W [rpc-transport.c:358:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed
>[2015-06-21 08:38:45.023405] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
>[2015-06-21 08:38:45.023422] E [glusterd.c:1515:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
>[2015-06-21 08:38:47.560231] I [glusterd-store.c:1986:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1
>[2015-06-21 08:38:47.568341] I [glusterd.c:154:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db
>[2015-06-21 08:38:47.568460] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600
>[2015-06-21 08:38:47.569322] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600
>[2015-06-21 08:38:47.577538] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600
>[2015-06-21 08:38:47.577980] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600
>[2015-06-21 08:38:47.578387] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600
>[2015-06-21 08:38:47.579286] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-21 08:38:48.529115] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-21 08:38:48.568038] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
>[2015-06-21 08:38:48.568138] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-21 08:38:48.591813] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-21 08:38:48.591835] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-21 08:38:48.596438] I [glusterd-store.c:3372:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume management
>  2:     type mgmt/glusterd
>  3:     option rpc-auth.auth-glusterfs on
>  4:     option rpc-auth.auth-unix on
>  5:     option rpc-auth.auth-null on
>  6:     option transport.socket.listen-backlog 128
>  7:     option ping-timeout 30
>  8:     option transport.socket.read-fail-log off
>  9:     option transport.socket.keepalive-interval 2
> 10:     option transport.socket.keepalive-time 10
> 11:     option transport-type rdma
> 12:     option working-directory /var/lib/glusterd
> 13: end-volume
> 14:  
>+------------------------------------------------------------------------------+
>[2015-06-21 08:38:48.601169] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
>[2015-06-21 08:38:48.602124] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1
>[2015-06-21 08:38:48.755074] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-21 08:38:48.755204] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: 0
>[2015-06-21 08:38:48.759463] I [glusterd-rpc-ops.c:464:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a, host: node02, port: 0
>[2015-06-21 08:38:48.761664] I [glusterd-handler.c:2587:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-21 08:38:48.761691] I [glusterd-handler.c:2630:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend
>[2015-06-21 08:38:48.761747] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:07:20.328434] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:07:20.328493] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:07:20.494202] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:07:20.494253] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:07:20.550346] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:07:20.550493] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:07:20.550625] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:07:20.550756] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:09:57.817767] W [socket.c:642:__socket_rwv] 0-management: readv on 192.168.136.105:24007 failed (No data available)
>[2015-06-25 08:09:57.817932] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd.
>[2015-06-25 08:10:02.230490] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1
>[2015-06-25 08:10:04.651199] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1
>[2015-06-25 08:10:04.654493] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:10:07.134255] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1
>[2015-06-25 08:10:07.138040] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:10:08.043789] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 7, Invalid argument
>[2015-06-25 08:10:08.043840] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 08:10:08.044832] I [socket.c:3432:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1)
>[2015-06-25 08:10:08.044853] E [rpcsvc.c:1312:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x5, Program: GlusterD svc peer, ProgVers: 2, Proc: 2) to rpc-transport (socket.management)
>[2015-06-25 08:10:08.044872] E [glusterd-utils.c:410:glusterd_submit_reply] 0-: Reply submission failed
>[2015-06-25 08:10:08.044882] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: -1
>[2015-06-25 08:10:08.044892] E [glusterd-sm.c:1224:glusterd_friend_sm] 0-glusterd: handler returned: -1
>[2015-06-25 08:10:08.044953] I [socket.c:3432:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1)
>[2015-06-25 08:10:08.044964] E [rpcsvc.c:1312:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x5, Program: GlusterD svc peer, ProgVers: 2, Proc: 2) to rpc-transport (socket.management)
>[2015-06-25 08:10:08.044975] E [glusterd-utils.c:410:glusterd_submit_reply] 0-: Reply submission failed
>[2015-06-25 08:10:08.044984] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: -1
>[2015-06-25 08:10:08.044991] E [glusterd-sm.c:1224:glusterd_friend_sm] 0-glusterd: handler returned: -1
>[2015-06-25 08:10:09.626959] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:10:09.627194] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:10:09.628146] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1
>[2015-06-25 08:10:09.692895] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:10:09.693019] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: 0
>[2015-06-25 08:10:09.697722] I [glusterd-rpc-ops.c:464:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a, host: node02, port: 0
>[2015-06-25 08:10:09.699714] I [glusterd-handler.c:2587:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:10:09.699740] I [glusterd-handler.c:2630:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend
>[2015-06-25 08:10:09.699808] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:10:53.534730] W [socket.c:642:__socket_rwv] 0-management: readv on 192.168.136.105:24007 failed (No data available)
>[2015-06-25 08:10:53.534902] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd.
>[2015-06-25 08:10:58.234513] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down
>[2015-06-25 08:11:00.248313] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-glusterd: Started running glusterd version 3.7.2 (args: glusterd --xlator-option *.upgrade=on -N)
>[2015-06-25 08:11:00.253550] I [graph.c:269:gf_add_cmdline_options] 0-management: adding option 'upgrade' for volume 'management' with value 'on'
>[2015-06-25 08:11:00.253635] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536
>[2015-06-25 08:11:00.253662] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory
>[2015-06-25 08:11:00.260829] E [rpc-transport.c:291:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.7.2/rpc-transport/rdma.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:11:00.260848] W [rpc-transport.c:295:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine
>[2015-06-25 08:11:00.260858] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
>[2015-06-25 08:11:00.260868] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
>[2015-06-25 08:11:02.463518] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1
>[2015-06-25 08:11:02.463638] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db
>[2015-06-25 08:11:02.463720] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600
>[2015-06-25 08:11:02.463929] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600
>[2015-06-25 08:11:02.464055] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600
>[2015-06-25 08:11:02.464187] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600
>[2015-06-25 08:11:02.464335] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600
>[2015-06-25 08:11:02.464528] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:03.479497] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:03.494059] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
>[2015-06-25 08:11:03.494135] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 08:11:03.500652] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 11, Invalid argument
>[2015-06-25 08:11:03.500673] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 08:11:03.501244] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume management
>  2:     type mgmt/glusterd
>  3:     option rpc-auth.auth-glusterfs on
>  4:     option rpc-auth.auth-unix on
>  5:     option rpc-auth.auth-null on
>  6:     option transport.socket.listen-backlog 128
>  7:     option upgrade on
>  8:     option ping-timeout 30
>  9:     option transport.socket.read-fail-log off
> 10:     option transport.socket.keepalive-interval 2
> 11:     option transport.socket.keepalive-time 10
> 12:     option transport-type rdma
> 13:     option working-directory /var/lib/glusterd
> 14: end-volume
> 15:  
>+------------------------------------------------------------------------------+
>[2015-06-25 08:11:03.514350] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down
>[2015-06-25 08:11:03.515200] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
>[2015-06-25 08:11:03.546583] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid)
>[2015-06-25 08:11:03.552234] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536
>[2015-06-25 08:11:03.552286] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory
>[2015-06-25 08:11:03.558022] E [rpc-transport.c:291:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.7.2/rpc-transport/rdma.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:11:03.558047] W [rpc-transport.c:295:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine
>[2015-06-25 08:11:03.558057] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
>[2015-06-25 08:11:03.558067] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
>[2015-06-25 08:11:05.824220] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1
>[2015-06-25 08:11:05.824371] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db
>[2015-06-25 08:11:05.824446] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600
>[2015-06-25 08:11:05.824626] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600
>[2015-06-25 08:11:05.824757] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600
>[2015-06-25 08:11:05.824893] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600
>[2015-06-25 08:11:05.825019] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600
>[2015-06-25 08:11:05.825205] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:06.736997] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:06.750314] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
>[2015-06-25 08:11:06.750401] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 08:11:06.755196] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 08:11:06.755218] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 08:11:06.755497] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume management
>  2:     type mgmt/glusterd
>  3:     option rpc-auth.auth-glusterfs on
>  4:     option rpc-auth.auth-unix on
>  5:     option rpc-auth.auth-null on
>  6:     option transport.socket.listen-backlog 128
>  7:     option ping-timeout 30
>  8:     option transport.socket.read-fail-log off
>  9:     option transport.socket.keepalive-interval 2
> 10:     option transport.socket.keepalive-time 10
> 11:     option transport-type rdma
> 12:     option working-directory /var/lib/glusterd
> 13: end-volume
> 14:  
>+------------------------------------------------------------------------------+
>[2015-06-25 08:11:06.757293] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
>[2015-06-25 08:11:06.927676] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down
>[2015-06-25 08:11:06.944232] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid)
>[2015-06-25 08:11:06.949557] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536
>[2015-06-25 08:11:06.949588] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory
>[2015-06-25 08:11:06.955203] E [rpc-transport.c:291:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.7.2/rpc-transport/rdma.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:11:06.955239] W [rpc-transport.c:295:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine
>[2015-06-25 08:11:06.955250] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
>[2015-06-25 08:11:06.955260] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
>[2015-06-25 08:11:09.144311] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1
>[2015-06-25 08:11:09.144434] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db
>[2015-06-25 08:11:09.144506] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600
>[2015-06-25 08:11:09.144691] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600
>[2015-06-25 08:11:09.144819] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600
>[2015-06-25 08:11:09.144950] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600
>[2015-06-25 08:11:09.145067] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600
>[2015-06-25 08:11:09.145249] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:10.057472] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:10.070479] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
>[2015-06-25 08:11:10.070567] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 08:11:10.074824] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 08:11:10.074845] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 08:11:10.075052] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume management
>  2:     type mgmt/glusterd
>  3:     option rpc-auth.auth-glusterfs on
>  4:     option rpc-auth.auth-unix on
>  5:     option rpc-auth.auth-null on
>  6:     option transport.socket.listen-backlog 128
>  7:     option ping-timeout 30
>  8:     option transport.socket.read-fail-log off
>  9:     option transport.socket.keepalive-interval 2
> 10:     option transport.socket.keepalive-time 10
> 11:     option transport-type rdma
> 12:     option working-directory /var/lib/glusterd
> 13: end-volume
> 14:  
>+------------------------------------------------------------------------------+
>[2015-06-25 08:11:10.076860] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
>[2015-06-25 08:11:10.185661] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down
>[2015-06-25 08:11:10.200952] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid)
>[2015-06-25 08:11:10.206350] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536
>[2015-06-25 08:11:10.206386] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory
>[2015-06-25 08:11:10.214641] W [rdma.c:4493:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device)
>[2015-06-25 08:11:10.214660] W [rdma.c:4793:init] 0-rdma.management: Failed to initialize IB Device
>[2015-06-25 08:11:10.214669] W [rpc-transport.c:358:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed
>[2015-06-25 08:11:10.214766] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
>[2015-06-25 08:11:10.214795] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
>[2015-06-25 08:11:12.432891] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1
>[2015-06-25 08:11:12.433022] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db
>[2015-06-25 08:11:12.433096] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600
>[2015-06-25 08:11:12.433312] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600
>[2015-06-25 08:11:12.433460] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600
>[2015-06-25 08:11:12.433600] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600
>[2015-06-25 08:11:12.433724] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600
>[2015-06-25 08:11:12.433903] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:13.352390] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:13.359608] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
>[2015-06-25 08:11:13.359718] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 08:11:13.364432] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 08:11:13.364454] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 08:11:13.364820] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume management
>  2:     type mgmt/glusterd
>  3:     option rpc-auth.auth-glusterfs on
>  4:     option rpc-auth.auth-unix on
>  5:     option rpc-auth.auth-null on
>  6:     option transport.socket.listen-backlog 128
>  7:     option ping-timeout 30
>  8:     option transport.socket.read-fail-log off
>  9:     option transport.socket.keepalive-interval 2
> 10:     option transport.socket.keepalive-time 10
> 11:     option transport-type rdma
> 12:     option working-directory /var/lib/glusterd
> 13: end-volume
> 14:  
>+------------------------------------------------------------------------------+
>[2015-06-25 08:11:13.366692] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
>[2015-06-25 08:11:16.123090] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down
>[2015-06-25 08:11:42.908422] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid)
>[2015-06-25 08:11:42.977323] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536
>[2015-06-25 08:11:42.977376] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory
>[2015-06-25 08:11:43.032163] W [rdma.c:4493:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device)
>[2015-06-25 08:11:43.032220] W [rdma.c:4793:init] 0-rdma.management: Failed to initialize IB Device
>[2015-06-25 08:11:43.032231] W [rpc-transport.c:358:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed
>[2015-06-25 08:11:43.032318] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
>[2015-06-25 08:11:43.032337] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
>[2015-06-25 08:11:45.620601] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1
>[2015-06-25 08:11:45.627909] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db
>[2015-06-25 08:11:45.628036] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600
>[2015-06-25 08:11:45.631795] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600
>[2015-06-25 08:11:45.638054] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600
>[2015-06-25 08:11:45.641826] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600
>[2015-06-25 08:11:45.645862] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600
>[2015-06-25 08:11:45.648261] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:46.586472] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 08:11:46.648006] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
>[2015-06-25 08:11:46.648096] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 08:11:46.680609] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 08:11:46.680631] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 08:11:46.684802] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume management
>  2:     type mgmt/glusterd
>  3:     option rpc-auth.auth-glusterfs on
>  4:     option rpc-auth.auth-unix on
>  5:     option rpc-auth.auth-null on
>  6:     option transport.socket.listen-backlog 128
>  7:     option ping-timeout 30
>  8:     option transport.socket.read-fail-log off
>  9:     option transport.socket.keepalive-interval 2
> 10:     option transport.socket.keepalive-time 10
> 11:     option transport-type rdma
> 12:     option working-directory /var/lib/glusterd
> 13: end-volume
> 14:  
>+------------------------------------------------------------------------------+
>[2015-06-25 08:11:46.689832] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
>[2015-06-25 08:11:46.690960] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1
>[2015-06-25 08:11:46.835555] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:11:46.835735] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: 0
>[2015-06-25 08:11:46.893411] I [glusterd-rpc-ops.c:464:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a, host: node02, port: 0
>[2015-06-25 08:11:46.896053] I [glusterd-handler.c:2587:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:11:46.896085] I [glusterd-handler.c:2630:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend
>[2015-06-25 08:11:46.896152] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a
>[2015-06-25 08:27:59.558056] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:27:59.558100] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:27:59.679201] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:27:59.679237] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:27:59.728807] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:27:59.728948] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:27:59.729080] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:27:59.729241] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:28:07.560628] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol1
>[2015-06-25 08:28:07.561832] E [glusterd-syncop.c:1272:gd_stage_op_phase] 0-management: Staging of operation 'Volume Status' failed on localhost : Volume vol1 is not started
>[2015-06-25 08:28:07.564146] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol2
>[2015-06-25 08:28:07.565304] E [glusterd-syncop.c:1272:gd_stage_op_phase] 0-management: Staging of operation 'Volume Status' failed on localhost : Volume vol2 is not started
>[2015-06-25 08:28:11.553656] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:28:11.555064] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:28:11.556446] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:28:21.597137] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:28:21.597200] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:28:21.637021] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:28:21.637052] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:28:21.639086] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:28:21.639243] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:28:21.639377] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:28:21.639508] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:28:46.574978] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick2 on port 49153
>[2015-06-25 08:28:46.576106] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 08:28:46.588872] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped
>[2015-06-25 08:28:46.611154] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol2 --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:28:46.623207] E [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x47c)[0x7f0874e33f9c] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol2 --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:28:46.635694] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S31ganesha-start.sh --volname=vol2 --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:29:14.302266] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol1
>[2015-06-25 08:29:14.303375] E [glusterd-syncop.c:1272:gd_stage_op_phase] 0-management: Staging of operation 'Volume Status' failed on localhost : Volume vol1 is not started
>[2015-06-25 08:29:14.305649] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol2
>[2015-06-25 08:29:14.309520] W [MSGID: 106217] [glusterd-op-sm.c:4489:glusterd_op_modify_op_ctx] 0-management: Failed uuid to hostname conversion
>[2015-06-25 08:29:14.309567] W [MSGID: 106387] [glusterd-op-sm.c:4585:glusterd_op_modify_op_ctx] 0-management: op_ctx modification failed
>[2015-06-25 08:29:17.434958] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:29:17.436434] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:29:17.437719] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:29:46.872634] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick on port 49152
>[2015-06-25 08:29:46.873090] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 08:29:46.890199] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped
>[2015-06-25 08:29:46.894961] W [socket.c:3059:socket_connect] 0-nfs: Ignore failed connection attempt on , (No such file or directory) 
>[2015-06-25 08:29:46.901243] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: glustershd already stopped
>[2015-06-25 08:29:46.904740] W [socket.c:3059:socket_connect] 0-glustershd: Ignore failed connection attempt on , (No such file or directory) 
>[2015-06-25 08:29:46.906626] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:29:46.906695] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:29:46.906750] W [socket.c:642:__socket_rwv] 0-glustershd: readv on /var/run/gluster/7db04d99d2007ae14fba8d840d3a368d.socket failed (Invalid argument)
>[2015-06-25 08:29:46.906777] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: glustershd has disconnected from glusterd.
>[2015-06-25 08:29:46.912310] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol1 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:29:46.925119] E [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x47c)[0x7f0874e33f9c] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol1 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:29:46.933818] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S31ganesha-start.sh --volname=vol1 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:29:58.023107] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0x55355)[0x7f0874db3355] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_op_commit_perform+0x46)[0x7f0874db96b6] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh --volname=vol2 --last=no
>[2015-06-25 08:29:58.031971] E [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x47c)[0x7f0874e33f9c] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0x55355)[0x7f0874db3355] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_op_commit_perform+0x46)[0x7f0874db96b6] ))))) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh --volname=vol2 --last=no
>[2015-06-25 08:29:58.032101] I [glusterd-utils.c:1370:glusterd_service_stop] 0-management: brick already stopped
>[2015-06-25 08:29:59.040377] I [glusterd-utils.c:4071:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully
>[2015-06-25 08:29:59.040669] I [glusterd-utils.c:4076:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully
>[2015-06-25 08:29:59.040941] I [glusterd-utils.c:4081:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully
>[2015-06-25 08:29:59.041223] I [glusterd-utils.c:4086:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully
>[2015-06-25 08:29:59.041478] I [glusterd-utils.c:4091:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully
>[2015-06-25 08:29:59.041742] I [glusterd-utils.c:4096:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully
>[2015-06-25 08:29:59.046693] I [MSGID: 106144] [glusterd-pmap.c:274:pmap_registry_remove] 0-pmap: removing brick /export/sdb1/brick2 on port 49153
>[2015-06-25 08:29:59.048389] I [mem-pool.c:604:mem_pool_destroy] 0-management: size=588 max=1 total=1
>[2015-06-25 08:29:59.048426] I [mem-pool.c:604:mem_pool_destroy] 0-management: size=124 max=1 total=1
>[2015-06-25 08:30:06.863239] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol1
>[2015-06-25 08:30:06.870197] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol2
>[2015-06-25 08:30:06.871334] E [glusterd-syncop.c:1272:gd_stage_op_phase] 0-management: Staging of operation 'Volume Status' failed on localhost : Volume vol2 is not started
>[2015-06-25 08:30:12.700944] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume info
>[2015-06-25 08:30:12.703270] E [glusterd-op-sm.c:3748:glusterd_dict_set_volid] 0-management: Volume info does not exist
>[2015-06-25 08:30:12.703310] E [glusterd-syncop.c:1845:gd_sync_task_begin] 0-management: Failed to build payload for operation 'Volume Status'
>[2015-06-25 08:30:16.988927] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:30:16.989700] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:30:16.990388] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:30:21.433592] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick2 on port 49153
>[2015-06-25 08:30:21.434402] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 08:30:22.442135] I [glusterd-utils.c:4071:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully
>[2015-06-25 08:30:22.442446] I [glusterd-utils.c:4076:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully
>[2015-06-25 08:30:22.442696] I [glusterd-utils.c:4081:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully
>[2015-06-25 08:30:22.442944] I [glusterd-utils.c:4086:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully
>[2015-06-25 08:30:22.443211] I [glusterd-utils.c:4091:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully
>[2015-06-25 08:30:22.443456] I [glusterd-utils.c:4096:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully
>[2015-06-25 08:30:22.454445] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol2 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:30:22.466188] E [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x47c)[0x7f0874e33f9c] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol2 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:30:22.474222] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S31ganesha-start.sh --volname=vol2 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:31:02.834485] I [glusterd-utils.c:4071:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully
>[2015-06-25 08:31:02.834832] I [glusterd-utils.c:4076:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully
>[2015-06-25 08:31:02.835125] I [glusterd-utils.c:4081:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully
>[2015-06-25 08:31:02.835442] I [glusterd-utils.c:4086:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully
>[2015-06-25 08:31:02.835716] I [glusterd-utils.c:4091:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully
>[2015-06-25 08:31:02.835985] I [glusterd-utils.c:4096:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully
>[2015-06-25 08:31:02.870606] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/set/post/S30samba-set.sh --volname=vol2 -o nfs.disable=off --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:31:02.885468] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh --volname=vol2 -o nfs.disable=off --gd-workdir=/var/lib/glusterd
>[2015-06-25 08:31:06.109914] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:09.110526] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:09.942705] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:31:09.943677] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:31:09.944671] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:31:12.111402] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:15.112063] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:18.112680] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:21.113361] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:24.113931] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:27.114444] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:30.115077] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:33.115715] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:36.116339] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:39.117007] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:42.117699] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 13 times between [2015-06-25 08:29:46.906695] and [2015-06-25 08:31:42.117820]
>[2015-06-25 08:31:45.118526] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:45.118640] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:31:48.119274] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:51.119946] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:54.120626] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:31:57.121328] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:00.121983] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:03.122698] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:06.123305] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:09.123909] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:12.124496] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:15.125114] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:18.125722] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:21.126326] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:24.126953] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:27.127608] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:30.128151] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:32.014792] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:32:33.129226] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:36.129897] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:39.130543] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:42.131229] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:45.131834] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:48.132531] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:51.133272] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:54.133879] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:32:57.134639] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:00.135313] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:03.136141] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:06.136857] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:09.137596] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:12.138282] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:15.139031] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:18.139769] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:21.140560] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:24.141298] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:27.142152] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:30.142860] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:33.143467] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:36.144206] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:39.145119] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:42.145842] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:31:45.118640] and [2015-06-25 08:33:42.145947]
>[2015-06-25 08:33:45.146504] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:45.146612] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:33:48.147365] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:51.148131] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:54.148811] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:33:57.149498] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:00.150238] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:03.150860] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:06.151887] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:09.152462] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:12.153071] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:15.153662] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:18.154348] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:21.155040] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:24.155641] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:27.156217] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:30.156834] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:33.157399] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:36.157982] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:39.158564] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:42.159213] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:45.159843] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:48.160575] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:51.161363] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:54.162002] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:34:57.162718] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:00.163399] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:03.164039] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:06.164839] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:09.165476] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:12.166135] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:15.166784] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:18.167445] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:21.168091] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:24.168787] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:27.169426] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:30.169903] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:33.170387] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:36.170953] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:39.171722] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:42.172361] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:33:45.146612] and [2015-06-25 08:35:42.172424]
>[2015-06-25 08:35:45.173240] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:45.173305] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:35:48.173880] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:51.174715] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:54.175399] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:35:57.176069] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:00.176808] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:03.177444] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:06.178368] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:09.179064] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:12.179748] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:15.180518] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:18.181206] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:21.181873] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:24.182568] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:27.183284] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:30.183914] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:33.184498] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:36.185224] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:39.185874] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:42.186551] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:45.187118] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:48.187760] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:51.188418] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:54.188988] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:36:57.189580] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:00.190216] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:03.190904] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:06.191720] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:09.192466] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:12.193140] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:15.193809] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:18.194486] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:21.195237] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:24.195895] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:27.196585] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:30.197308] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:33.197976] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:36.198661] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:39.199334] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:42.199930] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:35:45.173305] and [2015-06-25 08:37:42.200039]
>[2015-06-25 08:37:45.200593] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:45.200728] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:37:48.201148] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:51.201761] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:54.202409] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:37:57.202988] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:00.203661] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:03.204367] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:06.205465] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:09.206117] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:12.206817] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:15.207539] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:18.208309] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:21.209011] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:24.209824] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:27.210592] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:30.211331] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:33.212084] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:36.212838] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:39.213751] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:42.214412] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:45.214944] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:48.215629] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:51.216427] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:54.217084] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:38:57.217817] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:00.218513] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:03.219325] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:06.220046] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:09.220701] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:12.221345] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:15.221972] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:18.222687] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:21.223444] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:24.224135] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:27.224819] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:30.225511] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:33.226152] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:36.226829] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:39.227565] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:42.228182] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:37:45.200728] and [2015-06-25 08:39:42.228292]
>[2015-06-25 08:39:45.228895] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:45.228995] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:39:48.229513] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:51.230111] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:54.230722] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:39:57.231350] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:00.231953] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:03.232550] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:06.233367] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:09.234014] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:12.234673] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:15.235366] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:18.236097] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:21.236845] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:24.237529] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:27.238228] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:30.238876] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:33.239551] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:36.240653] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:39.241731] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:42.242482] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:45.243149] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:48.243873] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:51.244562] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:53.912267] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 08:40:54.245315] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:40:57.246010] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:00.246619] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:03.247283] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:06.248123] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:09.248778] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:12.249404] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:15.249963] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:18.250682] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:21.251377] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:24.252048] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:27.252735] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:30.253438] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:33.254151] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:36.254800] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:39.255490] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:42.256203] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:39:45.228995] and [2015-06-25 08:41:42.256300]
>[2015-06-25 08:41:45.256831] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:45.256912] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:41:48.257565] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:51.258243] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:54.258873] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:41:57.259551] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:00.260247] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:03.260920] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:06.261821] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:09.262502] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:12.263112] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:15.263710] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:18.264326] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:21.265041] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:24.265673] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:27.266367] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:30.266995] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:33.267645] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:36.268286] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:39.268948] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:42.269611] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:45.270212] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:48.270786] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:51.271426] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:54.272081] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:42:57.272757] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:00.273405] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:03.274074] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:06.274907] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:09.275625] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:12.276280] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:15.276945] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:18.277590] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:21.278230] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:24.278819] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:27.279482] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:30.280133] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:33.280751] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:36.281436] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:39.282116] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:42.282784] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:41:45.256912] and [2015-06-25 08:43:42.282886]
>[2015-06-25 08:43:45.283517] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:45.283626] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:43:48.284213] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:51.284908] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:54.285623] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:43:57.286374] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:00.287066] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:03.287688] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:06.288474] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:09.289101] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:12.289794] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:15.290374] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:18.290940] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:21.291548] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:24.292185] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:27.292733] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:30.293349] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:33.293919] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:36.294464] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:39.295049] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:42.295638] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:45.296303] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:48.296870] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:51.297532] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:54.298240] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:44:57.298973] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:00.299588] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:03.300229] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:06.301082] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:09.301772] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:12.302471] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:15.303215] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:18.303892] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:21.304582] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:24.305282] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:27.305929] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:30.306547] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:33.307091] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:36.307723] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:39.308398] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:42.309042] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:43:45.283626] and [2015-06-25 08:45:42.309147]
>[2015-06-25 08:45:45.309762] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:45.309890] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:45:48.310434] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:51.311064] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:54.311651] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:45:57.312348] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:00.313018] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:03.313878] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:06.314548] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:09.315300] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:12.315975] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:15.316617] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:18.317278] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:21.318016] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:24.318770] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:27.319435] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:30.320123] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:33.320654] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:36.321248] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:39.321728] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:42.322295] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:45.322909] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:48.323583] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:51.324286] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:54.324943] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:46:57.325584] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:00.326294] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:03.327132] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:06.327802] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:09.328495] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:12.329189] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:15.329859] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:18.330466] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:21.331148] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:24.331930] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:27.332635] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:30.333338] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:33.333958] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:36.334575] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:39.335241] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:42.335927] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:45:45.309890] and [2015-06-25 08:47:42.336035]
>[2015-06-25 08:47:45.336634] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:45.336756] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:47:48.337304] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:51.337921] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:54.338567] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:47:57.339215] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:00.339871] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:03.340730] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:06.341364] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:09.342051] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:12.342671] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:15.343322] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:18.343974] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:21.344681] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:24.345434] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:27.346108] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:30.346799] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:33.347434] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:36.348066] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:39.348732] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:42.349510] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:45.350481] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:48.351142] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:51.351869] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:54.352598] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:48:57.353252] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:00.353951] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:03.354620] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:06.355233] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:09.355833] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:12.356495] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:15.357150] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:18.357766] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:21.358373] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:24.358916] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:27.359545] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:30.360234] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:33.360862] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:36.361521] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:39.362185] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:42.362768] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:47:45.336756] and [2015-06-25 08:49:42.362882]
>[2015-06-25 08:49:45.363501] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:45.363619] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd.
>[2015-06-25 08:49:48.364062] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:51.364705] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:54.365357] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:49:57.366006] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:00.366682] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:03.367525] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:06.368202] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:09.368868] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:12.369551] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:15.370191] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:18.370813] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:21.371468] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:24.372101] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:27.372793] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:30.373478] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:33.374160] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:36.374854] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:39.375507] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:42.376191] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:45.376856] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:48.377478] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:51.378140] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:54.378857] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:50:57.379427] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:00.379996] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:03.380573] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:06.382021] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:09.382622] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:10.156148] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:51:10.156232] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:51:10.195813] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:51:10.195844] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory
>[2015-06-25 08:51:10.197761] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:51:10.197895] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:51:10.198027] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:51:10.198158] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods
>[2015-06-25 08:51:12.383662] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:15.384359] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:18.385406] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:21.386324] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:24.387206] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>[2015-06-25 08:51:27.387925] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument)
>The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 34 times between [2015-06-25 08:49:45.363619] and [2015-06-25 08:51:27.388024]
>[2015-06-25 08:51:27.552924] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down
>[2015-06-25 14:37:26.221150] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid)
>[2015-06-25 14:37:26.227529] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536
>[2015-06-25 14:37:26.227587] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory
>[2015-06-25 14:37:26.235984] W [rdma.c:4493:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device)
>[2015-06-25 14:37:26.236004] W [rdma.c:4793:init] 0-rdma.management: Failed to initialize IB Device
>[2015-06-25 14:37:26.236014] W [rpc-transport.c:358:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed
>[2015-06-25 14:37:26.236113] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
>[2015-06-25 14:37:26.236132] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
>[2015-06-25 14:37:28.465535] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1
>[2015-06-25 14:37:28.465661] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db
>[2015-06-25 14:37:28.465731] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600
>[2015-06-25 14:37:28.465928] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600
>[2015-06-25 14:37:28.466082] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600
>[2015-06-25 14:37:28.466252] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600
>[2015-06-25 14:37:28.466380] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600
>[2015-06-25 14:37:28.466576] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 14:37:29.416295] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2015-06-25 14:37:29.422748] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
>[2015-06-25 14:37:29.422835] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
>[2015-06-25 14:37:29.427813] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:29.427835] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:29.428127] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume management
>  2:     type mgmt/glusterd
>  3:     option rpc-auth.auth-glusterfs on
>  4:     option rpc-auth.auth-unix on
>  5:     option rpc-auth.auth-null on
>  6:     option transport.socket.listen-backlog 128
>  7:     option ping-timeout 30
>  8:     option transport.socket.read-fail-log off
>  9:     option transport.socket.keepalive-interval 2
> 10:     option transport.socket.keepalive-time 10
> 11:     option transport-type rdma
> 12:     option working-directory /var/lib/glusterd
> 13: end-volume
> 14:  
>+------------------------------------------------------------------------------+
>[2015-06-25 14:37:29.430269] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
>[2015-06-25 14:37:29.430345] E [socket.c:2332:socket_connect_finish] 0-management: connection to 192.168.136.105:24007 failed (Connection refused)
>[2015-06-25 14:37:29.430392] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd.
>[2015-06-25 14:37:29.431015] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick2 on port 49153
>[2015-06-25 14:37:29.432077] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick on port 49152
>[2015-06-25 14:37:33.226954] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:33.227001] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:36.231407] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:36.231470] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:39.235937] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:39.236008] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:42.240454] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:42.240523] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:45.244872] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:45.244940] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:48.249456] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:48.249535] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:51.254012] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:51.254082] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:54.258641] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:54.258706] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:37:57.263149] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:37:57.263235] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:00.267701] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:00.267767] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:03.272195] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:03.272262] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:06.276767] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:06.276837] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:09.281407] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:09.281475] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:12.285964] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:12.286030] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:15.290519] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:15.290589] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:18.295106] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:18.295197] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:21.300351] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:21.300430] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:24.304982] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:24.305048] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:27.309708] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:27.309776] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:30.314266] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:30.314334] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:33.318871] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:33.318941] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:36.323491] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:36.323557] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:39.328028] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:39.328095] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:42.332519] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:42.332585] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:45.337039] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:45.337107] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:48.341666] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:48.341733] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:51.346372] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:51.346439] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:54.350975] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:54.351046] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:38:57.355513] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:38:57.355584] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:00.359899] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:00.359966] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:03.364270] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:03.364335] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:06.368642] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:06.368704] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:09.372966] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:09.373032] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:12.377430] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:12.377495] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:15.381902] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:15.381971] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:18.386471] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:18.386540] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:21.391245] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:21.391357] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:24.395986] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:24.396052] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>The message "I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd." repeated 38 times between [2015-06-25 14:37:29.430392] and [2015-06-25 14:39:24.396619]
>[2015-06-25 14:39:27.400538] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:27.400580] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:27.401114] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd.
>[2015-06-25 14:39:30.404990] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:30.405055] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:33.409453] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:33.409519] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:36.413893] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:36.413956] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:39.418321] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:39.418388] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:42.422774] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:42.422827] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:45.427244] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:45.427311] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:48.431682] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:48.431740] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:51.436102] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:51.436192] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:54.440548] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:54.440615] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:39:57.445017] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:39:57.445088] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:00.449430] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:00.449494] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:03.453769] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:03.453836] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:06.458282] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:06.458349] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:09.462646] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:09.462713] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:12.466988] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:12.467050] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:12.810735] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol1
>[2015-06-25 14:40:12.812455] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol2
>[2015-06-25 14:40:14.402932] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 14:40:14.404365] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 14:40:14.405608] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 14:40:15.471794] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:15.471858] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:18.476309] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:18.476375] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:21.480952] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:21.481041] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:24.485529] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:24.485595] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:26.244434] I [glusterd-handler.c:1349:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req
>[2015-06-25 14:40:27.490454] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:27.490522] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:30.494854] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:30.494916] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:33.499382] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:33.499449] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:36.503974] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:36.504045] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:39.508627] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:39.508718] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:41.351887] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req
>[2015-06-25 14:40:42.513489] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:42.513560] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:45.518077] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:45.518146] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:48.522646] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:48.522713] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:51.527103] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:51.527193] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:54.531640] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:54.531707] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:40:57.536113] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:40:57.536205] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:00.540389] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:00.540431] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:03.544800] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:03.544868] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:06.549307] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:06.549379] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:09.553796] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:09.553858] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:12.558355] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:12.558400] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:15.562901] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:15.562965] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:18.567818] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:18.567899] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:21.572571] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:21.572652] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:24.577472] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:24.577539] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>The message "I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd." repeated 39 times between [2015-06-25 14:39:27.401114] and [2015-06-25 14:41:24.578195]
>[2015-06-25 14:41:27.582434] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:27.582486] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:27.583020] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd.
>[2015-06-25 14:41:30.586877] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:30.586943] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:33.591424] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:33.591491] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:36.596000] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:36.596067] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:39.600566] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:39.600635] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:42.605197] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:42.605268] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:45.609856] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:45.609925] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:48.614483] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:48.614549] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:51.619041] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:41:51.619110] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:54.623294] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:41:54.623325] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:41:57.628001] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:41:57.628065] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:00.632558] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:00.632630] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:03.636800] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:03.636857] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:06.641293] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:06.641385] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:09.646143] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:09.646238] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:12.650631] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:12.650702] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:15.655127] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:15.655221] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:18.659717] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:18.659787] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:21.664258] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:21.664319] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:24.668754] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:24.668826] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:27.673276] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:27.673344] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:30.677751] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:30.677822] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:33.682324] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:33.682392] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:36.686828] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:36.686899] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:39.691313] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:39.691382] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:42.695742] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:42.695811] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:45.700268] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:45.700336] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:48.704859] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:48.704929] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:51.709383] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:51.709438] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:54.713895] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:54.713968] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:42:57.718425] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:42:57.718493] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:00.722945] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:00.723012] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:03.727204] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:03.727271] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:06.731605] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:06.731671] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:09.736133] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:09.736218] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:12.740564] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:12.740624] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:15.745034] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:15.745103] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:18.749562] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:18.749630] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:21.754196] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:21.754294] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:24.758744] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:24.758809] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>The message "I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd." repeated 39 times between [2015-06-25 14:41:27.583020] and [2015-06-25 14:43:24.759339]
>[2015-06-25 14:43:27.763344] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:27.763404] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:27.763922] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd.
>[2015-06-25 14:43:30.767866] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:30.767934] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:33.772342] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:33.772429] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:36.776980] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:36.777051] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:39.781828] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:39.781893] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:42.786453] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:42.786519] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:45.791038] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:45.791107] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:48.795589] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:48.795662] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:51.800018] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:51.800071] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:54.804510] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:54.804577] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:43:57.808992] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:43:57.809063] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:00.813534] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:00.813605] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:03.817738] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:03.817802] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:06.821942] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:06.822007] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:09.826070] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:09.826133] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:12.830371] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:12.830435] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:15.834721] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:15.834785] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:18.838966] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:18.839033] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:21.843367] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:21.843448] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:24.847866] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:24.847936] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:27.852290] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:27.852358] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:30.856820] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:30.856890] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:33.861380] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:33.861449] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:36.866004] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:36.866078] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:39.870554] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:39.870621] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:42.875123] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:42.875217] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:45.879640] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:45.879708] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:48.884337] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:48.884411] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:51.888839] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:51.888894] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:54.893380] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:54.893453] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:44:57.897949] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:44:57.898019] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:00.902596] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:45:00.902672] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:03.907263] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:45:03.907332] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:06.911710] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:45:06.911775] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:09.916115] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:45:09.916194] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:12.920634] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:45:12.920720] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:15.925123] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:45:15.925234] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:18.929673] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:45:18.929737] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:21.934030] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument
>[2015-06-25 14:45:21.934070] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>[2015-06-25 14:45:24.938817] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument
>[2015-06-25 14:45:24.938883] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
>The message "I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd." repeated 39 times between [2015-06-25 14:43:27.763922] and [2015-06-25 14:45:24.939463]
>[2015-06-25 14:45:27.117211] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down

Actions: View

Attachments on bug 1222065: 1044665