Login
Log in using an SSO provider:
Fedora Account System
Red Hat Associate
Red Hat Customer
Login using a Red Hat Bugzilla account
Forgot Password
Create an Account
Red Hat Bugzilla – Attachment 1044665 Details for
Bug 1222065
GlusterD fills the logs when the NFS-server is disabled
Home
New
Search
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh92 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
[?]
This site requires JavaScript to be enabled to function correctly, please enable it.
glusterfs log node01
etc-glusterfs-glusterd.vol.log-20150628 (text/plain), 165.99 KB, created by
Anatoly Pugachev
on 2015-06-30 11:22:36 UTC
(
hide
)
Description:
glusterfs log node01
Filename:
MIME Type:
Creator:
Anatoly Pugachev
Created:
2015-06-30 11:22:36 UTC
Size:
165.99 KB
patch
obsolete
>[2015-06-21 08:35:46.919748] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-21 08:35:46.919822] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-21 08:35:46.960755] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-21 08:35:46.960793] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-21 08:35:46.962887] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-21 08:35:46.963032] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-21 08:35:46.963174] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-21 08:35:46.963314] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-21 08:38:13.109187] W [socket.c:642:__socket_rwv] 0-management: readv on 192.168.136.105:24007 failed (No data available) >[2015-06-21 08:38:13.109419] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd. >[2015-06-21 08:38:15.612407] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down >[2015-06-21 08:38:44.717594] I [MSGID: 100030] [glusterfsd.c:2294:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.1 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid) >[2015-06-21 08:38:44.915195] I [glusterd.c:1282:init] 0-management: Maximum allowed open file descriptors set to 65536 >[2015-06-21 08:38:44.915230] I [glusterd.c:1327:init] 0-management: Using /var/lib/glusterd as working directory >[2015-06-21 08:38:45.023287] W [rdma.c:4493:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device) >[2015-06-21 08:38:45.023310] W [rdma.c:4793:init] 0-rdma.management: Failed to initialize IB Device >[2015-06-21 08:38:45.023319] W [rpc-transport.c:358:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed >[2015-06-21 08:38:45.023405] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2015-06-21 08:38:45.023422] E [glusterd.c:1515:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport >[2015-06-21 08:38:47.560231] I [glusterd-store.c:1986:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1 >[2015-06-21 08:38:47.568341] I [glusterd.c:154:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db >[2015-06-21 08:38:47.568460] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 >[2015-06-21 08:38:47.569322] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 >[2015-06-21 08:38:47.577538] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 >[2015-06-21 08:38:47.577980] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 >[2015-06-21 08:38:47.578387] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 >[2015-06-21 08:38:47.579286] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-21 08:38:48.529115] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-21 08:38:48.568038] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 >[2015-06-21 08:38:48.568138] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-21 08:38:48.591813] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-21 08:38:48.591835] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-21 08:38:48.596438] I [glusterd-store.c:3372:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list. >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option ping-timeout 30 > 8: option transport.socket.read-fail-log off > 9: option transport.socket.keepalive-interval 2 > 10: option transport.socket.keepalive-time 10 > 11: option transport-type rdma > 12: option working-directory /var/lib/glusterd > 13: end-volume > 14: >+------------------------------------------------------------------------------+ >[2015-06-21 08:38:48.601169] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 >[2015-06-21 08:38:48.602124] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1 >[2015-06-21 08:38:48.755074] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-21 08:38:48.755204] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: 0 >[2015-06-21 08:38:48.759463] I [glusterd-rpc-ops.c:464:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a, host: node02, port: 0 >[2015-06-21 08:38:48.761664] I [glusterd-handler.c:2587:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-21 08:38:48.761691] I [glusterd-handler.c:2630:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend >[2015-06-21 08:38:48.761747] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:07:20.328434] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-25 08:07:20.328493] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-25 08:07:20.494202] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-25 08:07:20.494253] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-25 08:07:20.550346] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:07:20.550493] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:07:20.550625] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:07:20.550756] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.1/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:09:57.817767] W [socket.c:642:__socket_rwv] 0-management: readv on 192.168.136.105:24007 failed (No data available) >[2015-06-25 08:09:57.817932] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd. >[2015-06-25 08:10:02.230490] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1 >[2015-06-25 08:10:04.651199] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1 >[2015-06-25 08:10:04.654493] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:10:07.134255] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1 >[2015-06-25 08:10:07.138040] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:10:08.043789] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 7, Invalid argument >[2015-06-25 08:10:08.043840] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 08:10:08.044832] I [socket.c:3432:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1) >[2015-06-25 08:10:08.044853] E [rpcsvc.c:1312:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x5, Program: GlusterD svc peer, ProgVers: 2, Proc: 2) to rpc-transport (socket.management) >[2015-06-25 08:10:08.044872] E [glusterd-utils.c:410:glusterd_submit_reply] 0-: Reply submission failed >[2015-06-25 08:10:08.044882] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: -1 >[2015-06-25 08:10:08.044892] E [glusterd-sm.c:1224:glusterd_friend_sm] 0-glusterd: handler returned: -1 >[2015-06-25 08:10:08.044953] I [socket.c:3432:socket_submit_reply] 0-socket.management: not connected (priv->connected = -1) >[2015-06-25 08:10:08.044964] E [rpcsvc.c:1312:rpcsvc_submit_generic] 0-rpc-service: failed to submit message (XID: 0x5, Program: GlusterD svc peer, ProgVers: 2, Proc: 2) to rpc-transport (socket.management) >[2015-06-25 08:10:08.044975] E [glusterd-utils.c:410:glusterd_submit_reply] 0-: Reply submission failed >[2015-06-25 08:10:08.044984] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: -1 >[2015-06-25 08:10:08.044991] E [glusterd-sm.c:1224:glusterd_friend_sm] 0-glusterd: handler returned: -1 >[2015-06-25 08:10:09.626959] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:10:09.627194] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:10:09.628146] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1 >[2015-06-25 08:10:09.692895] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:10:09.693019] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: 0 >[2015-06-25 08:10:09.697722] I [glusterd-rpc-ops.c:464:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a, host: node02, port: 0 >[2015-06-25 08:10:09.699714] I [glusterd-handler.c:2587:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:10:09.699740] I [glusterd-handler.c:2630:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend >[2015-06-25 08:10:09.699808] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:10:53.534730] W [socket.c:642:__socket_rwv] 0-management: readv on 192.168.136.105:24007 failed (No data available) >[2015-06-25 08:10:53.534902] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd. >[2015-06-25 08:10:58.234513] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down >[2015-06-25 08:11:00.248313] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-glusterd: Started running glusterd version 3.7.2 (args: glusterd --xlator-option *.upgrade=on -N) >[2015-06-25 08:11:00.253550] I [graph.c:269:gf_add_cmdline_options] 0-management: adding option 'upgrade' for volume 'management' with value 'on' >[2015-06-25 08:11:00.253635] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536 >[2015-06-25 08:11:00.253662] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory >[2015-06-25 08:11:00.260829] E [rpc-transport.c:291:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.7.2/rpc-transport/rdma.so: cannot open shared object file: No such file or directory >[2015-06-25 08:11:00.260848] W [rpc-transport.c:295:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine >[2015-06-25 08:11:00.260858] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2015-06-25 08:11:00.260868] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport >[2015-06-25 08:11:02.463518] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1 >[2015-06-25 08:11:02.463638] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db >[2015-06-25 08:11:02.463720] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 >[2015-06-25 08:11:02.463929] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 >[2015-06-25 08:11:02.464055] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 >[2015-06-25 08:11:02.464187] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 >[2015-06-25 08:11:02.464335] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 >[2015-06-25 08:11:02.464528] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:03.479497] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:03.494059] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 >[2015-06-25 08:11:03.494135] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 08:11:03.500652] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 11, Invalid argument >[2015-06-25 08:11:03.500673] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 08:11:03.501244] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list. >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option upgrade on > 8: option ping-timeout 30 > 9: option transport.socket.read-fail-log off > 10: option transport.socket.keepalive-interval 2 > 11: option transport.socket.keepalive-time 10 > 12: option transport-type rdma > 13: option working-directory /var/lib/glusterd > 14: end-volume > 15: >+------------------------------------------------------------------------------+ >[2015-06-25 08:11:03.514350] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down >[2015-06-25 08:11:03.515200] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 >[2015-06-25 08:11:03.546583] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid) >[2015-06-25 08:11:03.552234] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536 >[2015-06-25 08:11:03.552286] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory >[2015-06-25 08:11:03.558022] E [rpc-transport.c:291:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.7.2/rpc-transport/rdma.so: cannot open shared object file: No such file or directory >[2015-06-25 08:11:03.558047] W [rpc-transport.c:295:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine >[2015-06-25 08:11:03.558057] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2015-06-25 08:11:03.558067] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport >[2015-06-25 08:11:05.824220] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1 >[2015-06-25 08:11:05.824371] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db >[2015-06-25 08:11:05.824446] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 >[2015-06-25 08:11:05.824626] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 >[2015-06-25 08:11:05.824757] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 >[2015-06-25 08:11:05.824893] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 >[2015-06-25 08:11:05.825019] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 >[2015-06-25 08:11:05.825205] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:06.736997] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:06.750314] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 >[2015-06-25 08:11:06.750401] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 08:11:06.755196] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 08:11:06.755218] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 08:11:06.755497] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list. >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option ping-timeout 30 > 8: option transport.socket.read-fail-log off > 9: option transport.socket.keepalive-interval 2 > 10: option transport.socket.keepalive-time 10 > 11: option transport-type rdma > 12: option working-directory /var/lib/glusterd > 13: end-volume > 14: >+------------------------------------------------------------------------------+ >[2015-06-25 08:11:06.757293] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 >[2015-06-25 08:11:06.927676] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down >[2015-06-25 08:11:06.944232] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid) >[2015-06-25 08:11:06.949557] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536 >[2015-06-25 08:11:06.949588] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory >[2015-06-25 08:11:06.955203] E [rpc-transport.c:291:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.7.2/rpc-transport/rdma.so: cannot open shared object file: No such file or directory >[2015-06-25 08:11:06.955239] W [rpc-transport.c:295:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine >[2015-06-25 08:11:06.955250] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2015-06-25 08:11:06.955260] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport >[2015-06-25 08:11:09.144311] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1 >[2015-06-25 08:11:09.144434] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db >[2015-06-25 08:11:09.144506] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 >[2015-06-25 08:11:09.144691] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 >[2015-06-25 08:11:09.144819] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 >[2015-06-25 08:11:09.144950] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 >[2015-06-25 08:11:09.145067] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 >[2015-06-25 08:11:09.145249] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:10.057472] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:10.070479] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 >[2015-06-25 08:11:10.070567] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 08:11:10.074824] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 08:11:10.074845] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 08:11:10.075052] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list. >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option ping-timeout 30 > 8: option transport.socket.read-fail-log off > 9: option transport.socket.keepalive-interval 2 > 10: option transport.socket.keepalive-time 10 > 11: option transport-type rdma > 12: option working-directory /var/lib/glusterd > 13: end-volume > 14: >+------------------------------------------------------------------------------+ >[2015-06-25 08:11:10.076860] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 >[2015-06-25 08:11:10.185661] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down >[2015-06-25 08:11:10.200952] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid) >[2015-06-25 08:11:10.206350] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536 >[2015-06-25 08:11:10.206386] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory >[2015-06-25 08:11:10.214641] W [rdma.c:4493:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device) >[2015-06-25 08:11:10.214660] W [rdma.c:4793:init] 0-rdma.management: Failed to initialize IB Device >[2015-06-25 08:11:10.214669] W [rpc-transport.c:358:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed >[2015-06-25 08:11:10.214766] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2015-06-25 08:11:10.214795] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport >[2015-06-25 08:11:12.432891] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1 >[2015-06-25 08:11:12.433022] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db >[2015-06-25 08:11:12.433096] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 >[2015-06-25 08:11:12.433312] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 >[2015-06-25 08:11:12.433460] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 >[2015-06-25 08:11:12.433600] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 >[2015-06-25 08:11:12.433724] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 >[2015-06-25 08:11:12.433903] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:13.352390] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:13.359608] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 >[2015-06-25 08:11:13.359718] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 08:11:13.364432] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 08:11:13.364454] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 08:11:13.364820] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list. >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option ping-timeout 30 > 8: option transport.socket.read-fail-log off > 9: option transport.socket.keepalive-interval 2 > 10: option transport.socket.keepalive-time 10 > 11: option transport-type rdma > 12: option working-directory /var/lib/glusterd > 13: end-volume > 14: >+------------------------------------------------------------------------------+ >[2015-06-25 08:11:13.366692] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 >[2015-06-25 08:11:16.123090] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down >[2015-06-25 08:11:42.908422] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid) >[2015-06-25 08:11:42.977323] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536 >[2015-06-25 08:11:42.977376] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory >[2015-06-25 08:11:43.032163] W [rdma.c:4493:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device) >[2015-06-25 08:11:43.032220] W [rdma.c:4793:init] 0-rdma.management: Failed to initialize IB Device >[2015-06-25 08:11:43.032231] W [rpc-transport.c:358:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed >[2015-06-25 08:11:43.032318] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2015-06-25 08:11:43.032337] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport >[2015-06-25 08:11:45.620601] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1 >[2015-06-25 08:11:45.627909] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db >[2015-06-25 08:11:45.628036] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 >[2015-06-25 08:11:45.631795] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 >[2015-06-25 08:11:45.638054] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 >[2015-06-25 08:11:45.641826] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 >[2015-06-25 08:11:45.645862] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 >[2015-06-25 08:11:45.648261] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:46.586472] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 08:11:46.648006] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 >[2015-06-25 08:11:46.648096] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 08:11:46.680609] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 08:11:46.680631] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 08:11:46.684802] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list. >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option ping-timeout 30 > 8: option transport.socket.read-fail-log off > 9: option transport.socket.keepalive-interval 2 > 10: option transport.socket.keepalive-time 10 > 11: option transport-type rdma > 12: option working-directory /var/lib/glusterd > 13: end-volume > 14: >+------------------------------------------------------------------------------+ >[2015-06-25 08:11:46.689832] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 >[2015-06-25 08:11:46.690960] I [glusterd-handshake.c:1151:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1 >[2015-06-25 08:11:46.835555] I [glusterd-handler.c:2424:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:11:46.835735] I [glusterd-handler.c:3582:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to node02 (0), ret: 0 >[2015-06-25 08:11:46.893411] I [glusterd-rpc-ops.c:464:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a, host: node02, port: 0 >[2015-06-25 08:11:46.896053] I [glusterd-handler.c:2587:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:11:46.896085] I [glusterd-handler.c:2630:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend >[2015-06-25 08:11:46.896152] I [glusterd-rpc-ops.c:669:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: e3a4c54b-1028-4c9d-8584-8160dd8cc50a >[2015-06-25 08:27:59.558056] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-25 08:27:59.558100] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-25 08:27:59.679201] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-25 08:27:59.679237] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-25 08:27:59.728807] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:27:59.728948] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:27:59.729080] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:27:59.729241] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:28:07.560628] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol1 >[2015-06-25 08:28:07.561832] E [glusterd-syncop.c:1272:gd_stage_op_phase] 0-management: Staging of operation 'Volume Status' failed on localhost : Volume vol1 is not started >[2015-06-25 08:28:07.564146] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol2 >[2015-06-25 08:28:07.565304] E [glusterd-syncop.c:1272:gd_stage_op_phase] 0-management: Staging of operation 'Volume Status' failed on localhost : Volume vol2 is not started >[2015-06-25 08:28:11.553656] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:28:11.555064] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:28:11.556446] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:28:21.597137] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-25 08:28:21.597200] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-25 08:28:21.637021] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-25 08:28:21.637052] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-25 08:28:21.639086] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:28:21.639243] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:28:21.639377] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:28:21.639508] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:28:46.574978] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick2 on port 49153 >[2015-06-25 08:28:46.576106] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 08:28:46.588872] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped >[2015-06-25 08:28:46.611154] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol2 --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:28:46.623207] E [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x47c)[0x7f0874e33f9c] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol2 --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:28:46.635694] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S31ganesha-start.sh --volname=vol2 --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:29:14.302266] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol1 >[2015-06-25 08:29:14.303375] E [glusterd-syncop.c:1272:gd_stage_op_phase] 0-management: Staging of operation 'Volume Status' failed on localhost : Volume vol1 is not started >[2015-06-25 08:29:14.305649] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol2 >[2015-06-25 08:29:14.309520] W [MSGID: 106217] [glusterd-op-sm.c:4489:glusterd_op_modify_op_ctx] 0-management: Failed uuid to hostname conversion >[2015-06-25 08:29:14.309567] W [MSGID: 106387] [glusterd-op-sm.c:4585:glusterd_op_modify_op_ctx] 0-management: op_ctx modification failed >[2015-06-25 08:29:17.434958] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:29:17.436434] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:29:17.437719] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:29:46.872634] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick on port 49152 >[2015-06-25 08:29:46.873090] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 08:29:46.890199] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped >[2015-06-25 08:29:46.894961] W [socket.c:3059:socket_connect] 0-nfs: Ignore failed connection attempt on , (No such file or directory) >[2015-06-25 08:29:46.901243] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: glustershd already stopped >[2015-06-25 08:29:46.904740] W [socket.c:3059:socket_connect] 0-glustershd: Ignore failed connection attempt on , (No such file or directory) >[2015-06-25 08:29:46.906626] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:29:46.906695] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:29:46.906750] W [socket.c:642:__socket_rwv] 0-glustershd: readv on /var/run/gluster/7db04d99d2007ae14fba8d840d3a368d.socket failed (Invalid argument) >[2015-06-25 08:29:46.906777] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: glustershd has disconnected from glusterd. >[2015-06-25 08:29:46.912310] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol1 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:29:46.925119] E [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x47c)[0x7f0874e33f9c] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol1 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:29:46.933818] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S31ganesha-start.sh --volname=vol1 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:29:58.023107] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0x55355)[0x7f0874db3355] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_op_commit_perform+0x46)[0x7f0874db96b6] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh --volname=vol2 --last=no >[2015-06-25 08:29:58.031971] E [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x47c)[0x7f0874e33f9c] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0x55355)[0x7f0874db3355] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_op_commit_perform+0x46)[0x7f0874db96b6] ))))) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh --volname=vol2 --last=no >[2015-06-25 08:29:58.032101] I [glusterd-utils.c:1370:glusterd_service_stop] 0-management: brick already stopped >[2015-06-25 08:29:59.040377] I [glusterd-utils.c:4071:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2015-06-25 08:29:59.040669] I [glusterd-utils.c:4076:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2015-06-25 08:29:59.040941] I [glusterd-utils.c:4081:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2015-06-25 08:29:59.041223] I [glusterd-utils.c:4086:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2015-06-25 08:29:59.041478] I [glusterd-utils.c:4091:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2015-06-25 08:29:59.041742] I [glusterd-utils.c:4096:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2015-06-25 08:29:59.046693] I [MSGID: 106144] [glusterd-pmap.c:274:pmap_registry_remove] 0-pmap: removing brick /export/sdb1/brick2 on port 49153 >[2015-06-25 08:29:59.048389] I [mem-pool.c:604:mem_pool_destroy] 0-management: size=588 max=1 total=1 >[2015-06-25 08:29:59.048426] I [mem-pool.c:604:mem_pool_destroy] 0-management: size=124 max=1 total=1 >[2015-06-25 08:30:06.863239] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol1 >[2015-06-25 08:30:06.870197] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol2 >[2015-06-25 08:30:06.871334] E [glusterd-syncop.c:1272:gd_stage_op_phase] 0-management: Staging of operation 'Volume Status' failed on localhost : Volume vol2 is not started >[2015-06-25 08:30:12.700944] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume info >[2015-06-25 08:30:12.703270] E [glusterd-op-sm.c:3748:glusterd_dict_set_volid] 0-management: Volume info does not exist >[2015-06-25 08:30:12.703310] E [glusterd-syncop.c:1845:gd_sync_task_begin] 0-management: Failed to build payload for operation 'Volume Status' >[2015-06-25 08:30:16.988927] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:30:16.989700] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:30:16.990388] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:30:21.433592] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick2 on port 49153 >[2015-06-25 08:30:21.434402] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 08:30:22.442135] I [glusterd-utils.c:4071:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2015-06-25 08:30:22.442446] I [glusterd-utils.c:4076:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2015-06-25 08:30:22.442696] I [glusterd-utils.c:4081:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2015-06-25 08:30:22.442944] I [glusterd-utils.c:4086:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2015-06-25 08:30:22.443211] I [glusterd-utils.c:4091:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2015-06-25 08:30:22.443456] I [glusterd-utils.c:4096:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2015-06-25 08:30:22.454445] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol2 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:30:22.466188] E [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x47c)[0x7f0874e33f9c] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol2 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:30:22.474222] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S31ganesha-start.sh --volname=vol2 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd >[2015-06-25 08:31:02.834485] I [glusterd-utils.c:4071:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully >[2015-06-25 08:31:02.834832] I [glusterd-utils.c:4076:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully >[2015-06-25 08:31:02.835125] I [glusterd-utils.c:4081:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully >[2015-06-25 08:31:02.835442] I [glusterd-utils.c:4086:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully >[2015-06-25 08:31:02.835716] I [glusterd-utils.c:4091:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully >[2015-06-25 08:31:02.835985] I [glusterd-utils.c:4096:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully >[2015-06-25 08:31:02.870606] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/set/post/S30samba-set.sh --volname=vol2 -o nfs.disable=off --gd-workdir=/var/lib/glusterd >[2015-06-25 08:31:02.885468] I [run.c:190:runner_log] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x147)[0x7f08802c9b87] (--> /lib64/libglusterfs.so.0(runner_log+0xf6)[0x7f08803146e6] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(glusterd_hooks_run_hooks+0x51d)[0x7f0874e3403d] (--> /usr/lib64/glusterfs/3.7.2/xlator/mgmt/glusterd.so(+0xd6512)[0x7f0874e34512] (--> /lib64/libpthread.so.0(+0x7555)[0x7f087f12d555] ))))) 0-management: Ran script: /var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh --volname=vol2 -o nfs.disable=off --gd-workdir=/var/lib/glusterd >[2015-06-25 08:31:06.109914] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:09.110526] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:09.942705] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:31:09.943677] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:31:09.944671] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:31:12.111402] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:15.112063] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:18.112680] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:21.113361] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:24.113931] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:27.114444] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:30.115077] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:33.115715] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:36.116339] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:39.117007] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:42.117699] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 13 times between [2015-06-25 08:29:46.906695] and [2015-06-25 08:31:42.117820] >[2015-06-25 08:31:45.118526] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:45.118640] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:31:48.119274] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:51.119946] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:54.120626] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:31:57.121328] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:00.121983] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:03.122698] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:06.123305] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:09.123909] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:12.124496] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:15.125114] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:18.125722] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:21.126326] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:24.126953] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:27.127608] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:30.128151] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:32.014792] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:32:33.129226] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:36.129897] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:39.130543] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:42.131229] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:45.131834] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:48.132531] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:51.133272] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:54.133879] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:32:57.134639] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:00.135313] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:03.136141] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:06.136857] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:09.137596] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:12.138282] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:15.139031] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:18.139769] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:21.140560] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:24.141298] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:27.142152] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:30.142860] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:33.143467] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:36.144206] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:39.145119] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:42.145842] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:31:45.118640] and [2015-06-25 08:33:42.145947] >[2015-06-25 08:33:45.146504] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:45.146612] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:33:48.147365] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:51.148131] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:54.148811] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:33:57.149498] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:00.150238] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:03.150860] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:06.151887] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:09.152462] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:12.153071] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:15.153662] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:18.154348] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:21.155040] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:24.155641] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:27.156217] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:30.156834] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:33.157399] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:36.157982] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:39.158564] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:42.159213] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:45.159843] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:48.160575] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:51.161363] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:54.162002] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:34:57.162718] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:00.163399] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:03.164039] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:06.164839] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:09.165476] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:12.166135] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:15.166784] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:18.167445] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:21.168091] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:24.168787] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:27.169426] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:30.169903] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:33.170387] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:36.170953] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:39.171722] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:42.172361] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:33:45.146612] and [2015-06-25 08:35:42.172424] >[2015-06-25 08:35:45.173240] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:45.173305] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:35:48.173880] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:51.174715] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:54.175399] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:35:57.176069] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:00.176808] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:03.177444] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:06.178368] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:09.179064] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:12.179748] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:15.180518] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:18.181206] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:21.181873] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:24.182568] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:27.183284] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:30.183914] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:33.184498] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:36.185224] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:39.185874] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:42.186551] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:45.187118] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:48.187760] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:51.188418] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:54.188988] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:36:57.189580] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:00.190216] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:03.190904] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:06.191720] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:09.192466] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:12.193140] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:15.193809] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:18.194486] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:21.195237] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:24.195895] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:27.196585] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:30.197308] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:33.197976] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:36.198661] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:39.199334] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:42.199930] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:35:45.173305] and [2015-06-25 08:37:42.200039] >[2015-06-25 08:37:45.200593] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:45.200728] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:37:48.201148] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:51.201761] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:54.202409] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:37:57.202988] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:00.203661] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:03.204367] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:06.205465] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:09.206117] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:12.206817] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:15.207539] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:18.208309] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:21.209011] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:24.209824] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:27.210592] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:30.211331] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:33.212084] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:36.212838] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:39.213751] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:42.214412] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:45.214944] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:48.215629] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:51.216427] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:54.217084] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:38:57.217817] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:00.218513] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:03.219325] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:06.220046] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:09.220701] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:12.221345] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:15.221972] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:18.222687] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:21.223444] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:24.224135] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:27.224819] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:30.225511] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:33.226152] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:36.226829] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:39.227565] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:42.228182] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:37:45.200728] and [2015-06-25 08:39:42.228292] >[2015-06-25 08:39:45.228895] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:45.228995] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:39:48.229513] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:51.230111] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:54.230722] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:39:57.231350] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:00.231953] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:03.232550] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:06.233367] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:09.234014] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:12.234673] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:15.235366] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:18.236097] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:21.236845] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:24.237529] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:27.238228] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:30.238876] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:33.239551] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:36.240653] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:39.241731] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:42.242482] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:45.243149] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:48.243873] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:51.244562] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:53.912267] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 08:40:54.245315] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:40:57.246010] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:00.246619] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:03.247283] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:06.248123] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:09.248778] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:12.249404] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:15.249963] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:18.250682] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:21.251377] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:24.252048] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:27.252735] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:30.253438] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:33.254151] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:36.254800] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:39.255490] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:42.256203] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:39:45.228995] and [2015-06-25 08:41:42.256300] >[2015-06-25 08:41:45.256831] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:45.256912] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:41:48.257565] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:51.258243] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:54.258873] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:41:57.259551] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:00.260247] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:03.260920] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:06.261821] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:09.262502] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:12.263112] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:15.263710] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:18.264326] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:21.265041] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:24.265673] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:27.266367] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:30.266995] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:33.267645] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:36.268286] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:39.268948] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:42.269611] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:45.270212] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:48.270786] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:51.271426] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:54.272081] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:42:57.272757] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:00.273405] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:03.274074] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:06.274907] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:09.275625] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:12.276280] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:15.276945] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:18.277590] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:21.278230] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:24.278819] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:27.279482] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:30.280133] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:33.280751] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:36.281436] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:39.282116] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:42.282784] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:41:45.256912] and [2015-06-25 08:43:42.282886] >[2015-06-25 08:43:45.283517] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:45.283626] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:43:48.284213] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:51.284908] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:54.285623] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:43:57.286374] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:00.287066] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:03.287688] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:06.288474] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:09.289101] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:12.289794] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:15.290374] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:18.290940] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:21.291548] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:24.292185] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:27.292733] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:30.293349] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:33.293919] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:36.294464] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:39.295049] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:42.295638] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:45.296303] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:48.296870] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:51.297532] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:54.298240] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:44:57.298973] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:00.299588] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:03.300229] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:06.301082] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:09.301772] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:12.302471] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:15.303215] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:18.303892] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:21.304582] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:24.305282] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:27.305929] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:30.306547] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:33.307091] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:36.307723] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:39.308398] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:42.309042] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:43:45.283626] and [2015-06-25 08:45:42.309147] >[2015-06-25 08:45:45.309762] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:45.309890] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:45:48.310434] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:51.311064] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:54.311651] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:45:57.312348] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:00.313018] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:03.313878] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:06.314548] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:09.315300] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:12.315975] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:15.316617] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:18.317278] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:21.318016] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:24.318770] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:27.319435] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:30.320123] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:33.320654] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:36.321248] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:39.321728] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:42.322295] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:45.322909] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:48.323583] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:51.324286] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:54.324943] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:46:57.325584] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:00.326294] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:03.327132] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:06.327802] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:09.328495] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:12.329189] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:15.329859] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:18.330466] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:21.331148] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:24.331930] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:27.332635] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:30.333338] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:33.333958] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:36.334575] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:39.335241] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:42.335927] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:45:45.309890] and [2015-06-25 08:47:42.336035] >[2015-06-25 08:47:45.336634] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:45.336756] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:47:48.337304] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:51.337921] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:54.338567] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:47:57.339215] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:00.339871] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:03.340730] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:06.341364] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:09.342051] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:12.342671] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:15.343322] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:18.343974] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:21.344681] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:24.345434] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:27.346108] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:30.346799] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:33.347434] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:36.348066] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:39.348732] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:42.349510] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:45.350481] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:48.351142] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:51.351869] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:54.352598] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:48:57.353252] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:00.353951] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:03.354620] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:06.355233] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:09.355833] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:12.356495] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:15.357150] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:18.357766] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:21.358373] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:24.358916] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:27.359545] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:30.360234] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:33.360862] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:36.361521] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:39.362185] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:42.362768] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 39 times between [2015-06-25 08:47:45.336756] and [2015-06-25 08:49:42.362882] >[2015-06-25 08:49:45.363501] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:45.363619] I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd. >[2015-06-25 08:49:48.364062] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:51.364705] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:54.365357] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:49:57.366006] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:00.366682] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:03.367525] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:06.368202] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:09.368868] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:12.369551] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:15.370191] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:18.370813] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:21.371468] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:24.372101] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:27.372793] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:30.373478] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:33.374160] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:36.374854] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:39.375507] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:42.376191] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:45.376856] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:48.377478] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:51.378140] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:54.378857] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:50:57.379427] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:00.379996] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:03.380573] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:06.382021] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:09.382622] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:10.156148] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-25 08:51:10.156232] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/rpc-transport/socket.so: cannot open shared object file: No such file or directory >[2015-06-25 08:51:10.195813] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-25 08:51:10.195844] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/configuration.so: cannot open shared object file: No such file or directory >[2015-06-25 08:51:10.197761] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:51:10.197895] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:51:10.198027] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:51:10.198158] W [xlator.c:141:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.7.2/xlator/cluster/tier.so: undefined symbol: dht_methods >[2015-06-25 08:51:12.383662] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:15.384359] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:18.385406] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:21.386324] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:24.387206] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >[2015-06-25 08:51:27.387925] W [socket.c:642:__socket_rwv] 0-nfs: readv on /var/run/gluster/5cf388ba8b9610c52604425a16955178.socket failed (Invalid argument) >The message "I [MSGID: 106006] [glusterd-svc-mgmt.c:330:glusterd_svc_common_rpc_notify] 0-management: nfs has disconnected from glusterd." repeated 34 times between [2015-06-25 08:49:45.363619] and [2015-06-25 08:51:27.388024] >[2015-06-25 08:51:27.552924] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down >[2015-06-25 14:37:26.221150] I [MSGID: 100030] [glusterfsd.c:2301:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid) >[2015-06-25 14:37:26.227529] I [glusterd.c:1372:init] 0-management: Maximum allowed open file descriptors set to 65536 >[2015-06-25 14:37:26.227587] I [glusterd.c:1420:init] 0-management: Using /var/lib/glusterd as working directory >[2015-06-25 14:37:26.235984] W [rdma.c:4493:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device) >[2015-06-25 14:37:26.236004] W [rdma.c:4793:init] 0-rdma.management: Failed to initialize IB Device >[2015-06-25 14:37:26.236014] W [rpc-transport.c:358:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed >[2015-06-25 14:37:26.236113] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed >[2015-06-25 14:37:26.236132] E [MSGID: 106243] [glusterd.c:1646:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport >[2015-06-25 14:37:28.465535] I [glusterd-store.c:2035:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 1 >[2015-06-25 14:37:28.465661] I [glusterd.c:156:glusterd_uuid_init] 0-management: retrieved UUID: 6fbbd20d-cac0-4944-ba73-4cd4690870db >[2015-06-25 14:37:28.465731] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 >[2015-06-25 14:37:28.465928] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 >[2015-06-25 14:37:28.466082] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 >[2015-06-25 14:37:28.466252] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 >[2015-06-25 14:37:28.466380] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 >[2015-06-25 14:37:28.466576] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 14:37:29.416295] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 >[2015-06-25 14:37:29.422748] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 >[2015-06-25 14:37:29.422835] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 >[2015-06-25 14:37:29.427813] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:29.427835] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:29.428127] I [MSGID: 106194] [glusterd-store.c:3467:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list. >Final graph: >+------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option transport.socket.listen-backlog 128 > 7: option ping-timeout 30 > 8: option transport.socket.read-fail-log off > 9: option transport.socket.keepalive-interval 2 > 10: option transport.socket.keepalive-time 10 > 11: option transport-type rdma > 12: option working-directory /var/lib/glusterd > 13: end-volume > 14: >+------------------------------------------------------------------------------+ >[2015-06-25 14:37:29.430269] I [event-epoll.c:629:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 >[2015-06-25 14:37:29.430345] E [socket.c:2332:socket_connect_finish] 0-management: connection to 192.168.136.105:24007 failed (Connection refused) >[2015-06-25 14:37:29.430392] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd. >[2015-06-25 14:37:29.431015] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick2 on port 49153 >[2015-06-25 14:37:29.432077] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /export/sdb1/brick on port 49152 >[2015-06-25 14:37:33.226954] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:33.227001] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:36.231407] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:36.231470] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:39.235937] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:39.236008] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:42.240454] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:42.240523] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:45.244872] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:45.244940] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:48.249456] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:48.249535] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:51.254012] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:51.254082] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:54.258641] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:54.258706] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:37:57.263149] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:37:57.263235] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:00.267701] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:00.267767] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:03.272195] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:03.272262] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:06.276767] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:06.276837] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:09.281407] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:09.281475] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:12.285964] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:12.286030] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:15.290519] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:15.290589] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:18.295106] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:18.295197] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:21.300351] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:21.300430] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:24.304982] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:24.305048] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:27.309708] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:27.309776] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:30.314266] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:30.314334] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:33.318871] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:33.318941] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:36.323491] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:36.323557] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:39.328028] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:39.328095] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:42.332519] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:42.332585] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:45.337039] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:45.337107] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:48.341666] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:48.341733] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:51.346372] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:51.346439] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:54.350975] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:54.351046] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:38:57.355513] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:38:57.355584] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:00.359899] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:00.359966] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:03.364270] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:03.364335] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:06.368642] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:06.368704] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:09.372966] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:09.373032] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:12.377430] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:12.377495] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:15.381902] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:15.381971] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:18.386471] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:18.386540] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:21.391245] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:21.391357] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:24.395986] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:24.396052] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >The message "I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd." repeated 38 times between [2015-06-25 14:37:29.430392] and [2015-06-25 14:39:24.396619] >[2015-06-25 14:39:27.400538] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:27.400580] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:27.401114] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd. >[2015-06-25 14:39:30.404990] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:30.405055] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:33.409453] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:33.409519] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:36.413893] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:36.413956] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:39.418321] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:39.418388] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:42.422774] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:42.422827] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:45.427244] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:45.427311] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:48.431682] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:48.431740] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:51.436102] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:51.436192] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:54.440548] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:54.440615] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:39:57.445017] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:39:57.445088] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:00.449430] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:00.449494] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:03.453769] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:03.453836] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:06.458282] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:06.458349] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:09.462646] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:09.462713] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:12.466988] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:12.467050] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:12.810735] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol1 >[2015-06-25 14:40:12.812455] I [glusterd-handler.c:4059:__glusterd_handle_status_volume] 0-management: Received status volume req for volume vol2 >[2015-06-25 14:40:14.402932] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 14:40:14.404365] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 14:40:14.405608] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 14:40:15.471794] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:15.471858] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:18.476309] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:18.476375] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:21.480952] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:21.481041] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:24.485529] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:24.485595] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:26.244434] I [glusterd-handler.c:1349:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req >[2015-06-25 14:40:27.490454] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:27.490522] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:30.494854] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:30.494916] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:33.499382] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:33.499449] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:36.503974] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:36.504045] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:39.508627] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:39.508718] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:41.351887] I [glusterd-handler.c:1404:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >[2015-06-25 14:40:42.513489] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:42.513560] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:45.518077] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:45.518146] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:48.522646] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:48.522713] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:51.527103] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:51.527193] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:54.531640] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:54.531707] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:40:57.536113] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:40:57.536205] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:00.540389] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:00.540431] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:03.544800] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:03.544868] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:06.549307] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:06.549379] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:09.553796] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:09.553858] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:12.558355] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:12.558400] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:15.562901] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:15.562965] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:18.567818] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:18.567899] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:21.572571] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:21.572652] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:24.577472] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:24.577539] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >The message "I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd." repeated 39 times between [2015-06-25 14:39:27.401114] and [2015-06-25 14:41:24.578195] >[2015-06-25 14:41:27.582434] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:27.582486] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:27.583020] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd. >[2015-06-25 14:41:30.586877] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:30.586943] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:33.591424] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:33.591491] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:36.596000] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:36.596067] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:39.600566] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:39.600635] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:42.605197] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:42.605268] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:45.609856] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:45.609925] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:48.614483] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:48.614549] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:51.619041] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:41:51.619110] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:54.623294] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:41:54.623325] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:41:57.628001] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:41:57.628065] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:00.632558] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:00.632630] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:03.636800] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:03.636857] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:06.641293] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:06.641385] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:09.646143] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:09.646238] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:12.650631] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:12.650702] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:15.655127] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:15.655221] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:18.659717] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:18.659787] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:21.664258] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:21.664319] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:24.668754] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:24.668826] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:27.673276] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:27.673344] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:30.677751] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:30.677822] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:33.682324] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:33.682392] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:36.686828] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:36.686899] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:39.691313] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:39.691382] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:42.695742] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:42.695811] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:45.700268] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:45.700336] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:48.704859] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:48.704929] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:51.709383] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:51.709438] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:54.713895] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:54.713968] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:42:57.718425] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:42:57.718493] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:00.722945] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:00.723012] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:03.727204] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:03.727271] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:06.731605] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:06.731671] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:09.736133] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:09.736218] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:12.740564] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:12.740624] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:15.745034] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:15.745103] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:18.749562] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:18.749630] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:21.754196] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:21.754294] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:24.758744] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:24.758809] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >The message "I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd." repeated 39 times between [2015-06-25 14:41:27.583020] and [2015-06-25 14:43:24.759339] >[2015-06-25 14:43:27.763344] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:27.763404] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:27.763922] I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd. >[2015-06-25 14:43:30.767866] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:30.767934] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:33.772342] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:33.772429] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:36.776980] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:36.777051] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:39.781828] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:39.781893] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:42.786453] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:42.786519] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:45.791038] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:45.791107] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:48.795589] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:48.795662] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:51.800018] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:51.800071] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:54.804510] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:54.804577] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:43:57.808992] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:43:57.809063] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:00.813534] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:00.813605] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:03.817738] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:03.817802] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:06.821942] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:06.822007] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:09.826070] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:09.826133] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:12.830371] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:12.830435] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:15.834721] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:15.834785] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:18.838966] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:18.839033] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:21.843367] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:21.843448] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:24.847866] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:24.847936] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:27.852290] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:27.852358] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:30.856820] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:30.856890] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:33.861380] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:33.861449] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:36.866004] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:36.866078] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:39.870554] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:39.870621] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:42.875123] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:42.875217] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:45.879640] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:45.879708] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:48.884337] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:48.884411] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:51.888839] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:51.888894] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:54.893380] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:54.893453] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:44:57.897949] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:44:57.898019] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:00.902596] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:45:00.902672] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:03.907263] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:45:03.907332] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:06.911710] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:45:06.911775] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:09.916115] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:45:09.916194] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:12.920634] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:45:12.920720] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:15.925123] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:45:15.925234] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:18.929673] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:45:18.929737] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:21.934030] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 14, Invalid argument >[2015-06-25 14:45:21.934070] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >[2015-06-25 14:45:24.938817] W [socket.c:923:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument >[2015-06-25 14:45:24.938883] E [socket.c:3015:socket_connect] 0-management: Failed to set keep-alive: Invalid argument >The message "I [MSGID: 106004] [glusterd-handler.c:4814:__glusterd_peer_rpc_notify] 0-management: Peer <node02> (<e3a4c54b-1028-4c9d-8584-8160dd8cc50a>), in state <Peer in Cluster>, has disconnected from glusterd." repeated 39 times between [2015-06-25 14:43:27.763922] and [2015-06-25 14:45:24.939463] >[2015-06-25 14:45:27.117211] W [glusterfsd.c:1219:cleanup_and_exit] (--> 0-: received signum (15), shutting down
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1222065
: 1044665