Attachment 1353009 Details for Bug 1513736 – Output from bug1283983 test program

Output from bug1283983 test program

bug1283983.log (text/plain), 74.84 KB, created by Dustin Black on 2017-11-15 21:37:45 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Dustin Black

Created: 2017-11-15 21:37:45 UTC

Size: 74.84 KB

patch

obsolete

>[2017-11-13 22:07:38.989313] E [socket.c:2360:socket_connect_finish] 0-gfapi: connection to ::1%1:24007 failed (Connection refused); disconnecting socket
>[2017-11-13 22:07:38.990404] I [MSGID: 104024] [glfs-mgmt.c:801:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
>[2017-11-13 22:07:42.968369] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-gluster1-readdir-ahead: option 'parallel-readdir' is not recognized
>[2017-11-13 22:07:42.969174] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 6e312e65-7861-6d70-6c65-2e636f6d2d32 (0) coming up
>[2017-11-13 22:07:42.969193] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-0: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.971643] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-1: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.971971] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-0: changing port to 49153 (from 0)
>[2017-11-13 22:07:42.973776] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-2: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.974200] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-1: changing port to 49153 (from 0)
>[2017-11-13 22:07:42.976458] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:42.977046] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-0: Connected to gluster1-client-0, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:07:42.977093] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-0: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:07:42.977230] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-0: Server lk version = 1
>[2017-11-13 22:07:42.978346] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-3: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.978865] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-2: changing port to 49153 (from 0)
>[2017-11-13 22:07:42.980676] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:42.981259] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-1: Connected to gluster1-client-1, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:07:42.981272] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-1: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:07:42.981480] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-1: Server lk version = 1
>[2017-11-13 22:07:42.982415] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-4: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.982839] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-3: changing port to 49153 (from 0)
>[2017-11-13 22:07:42.984602] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:42.985182] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-2: Connected to gluster1-client-2, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:07:42.985192] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-2: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:07:42.985312] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-2: Server lk version = 1
>[2017-11-13 22:07:42.986633] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-5: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.987063] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-4: changing port to 49153 (from 0)
>[2017-11-13 22:07:42.988752] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:42.989350] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-3: Connected to gluster1-client-3, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:07:42.989365] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-3: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:07:42.989512] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-3: Server lk version = 1
>[2017-11-13 22:07:42.990483] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-6: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.990764] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-5: changing port to 49152 (from 0)
>[2017-11-13 22:07:42.992750] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:42.993368] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-4: Connected to gluster1-client-4, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:07:42.993380] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-4: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:07:42.993494] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-4: Server lk version = 1
>[2017-11-13 22:07:42.994495] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-7: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.994673] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-6: changing port to 49154 (from 0)
>[2017-11-13 22:07:42.996806] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:42.997289] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-5: Connected to gluster1-client-5, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:07:42.997303] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-5: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:07:42.997328] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-0: Going UP
>[2017-11-13 22:07:42.997500] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-5: Server lk version = 1
>[2017-11-13 22:07:42.998531] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-8: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:42.998938] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-7: changing port to 49154 (from 0)
>[2017-11-13 22:07:43.000810] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:43.001201] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-6: Connected to gluster1-client-6, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:07:43.001217] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-6: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:07:43.003013] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-9: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.005253] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-6: Server lk version = 1
>[2017-11-13 22:07:43.005501] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:43.005574] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-8: changing port to 49154 (from 0)
>[2017-11-13 22:07:43.007221] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-10: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.009280] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-7: Connected to gluster1-client-7, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:07:43.009299] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-7: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:07:43.011233] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-11: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.013344] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-12: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.015474] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-13: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.017604] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-14: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.019710] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-15: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.021697] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-16: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.023819] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-17: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.025844] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-18: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.027917] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-19: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.029911] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-20: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.031963] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-21: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.033952] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-22: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.036074] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-23: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.038030] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-24: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.040122] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-25: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.042286] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-26: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.044384] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-27: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.046341] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-28: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.048441] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-29: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.050443] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-30: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.052696] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-31: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.054713] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-32: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.056790] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-33: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.058753] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-34: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.060823] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-35: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.062789] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-36: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.064881] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-37: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.066890] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-38: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.068962] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-39: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.070964] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-40: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.073022] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-41: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.075113] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-42: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.077179] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-43: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.079404] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-44: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.081434] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-45: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.083499] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-46: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.085532] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-47: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.087631] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-48: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.089673] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-49: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.091801] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-50: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.093799] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-51: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.095857] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-52: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.097865] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-53: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.099930] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-54: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.102081] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-55: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.104202] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-56: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.106177] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-57: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.108257] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-58: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.110272] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-59: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.112385] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-60: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.114486] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-61: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.116681] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-62: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.118657] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-63: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.120750] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-64: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.122786] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-65: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.124904] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-66: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.126998] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-67: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.129290] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-68: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.131405] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-69: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.133566] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-70: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.135623] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-71: parent translators are ready, attempting connect on transport
>[2017-11-13 22:07:43.137766] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-7: Server lk version = 1
>[2017-11-13 22:07:43.138619] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:07:43.139450] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-10: changing port to 49154 (from 0)
>[2017-11-13 22:07:43.139470] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-12: changing port to 49155 (from 0)
>[2017-11-13 22:07:43.139487] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-18: changing port to 49156 (from 0)
>[2017-11-13 22:07:43.139504] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-9: changing port to 49154 (from 0)
>[2017-11-13 22:07:43.139516] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-14: changing port to 49155 (from 0)
>[2017-11-13 22:07:43.139529] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-24: changing port to 49157 (from 0)
>[2017-11-13 22:07:43.139544] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-16: changing port to 49155 (from 0)
>[2017-11-13 22:07:43.139556] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-15: changing port to 49155 (from 0)
>[2017-11-13 22:07:43.139568] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-21: changing port to 49156 (from 0)
>[2017-11-13 22:07:43.139580] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-22: changing port to 49156 (from 0)
>[2017-11-13 22:07:43.139592] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-20: changing port to 49156 (from 0)
>[2017-11-13 22:07:43.139604] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-11: changing port to 49153 (from 0)
>[2017-11-13 22:07:43.139616] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-26: changing port to 49157 (from 0)
>[2017-11-13 22:07:43.139628] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-30: changing port to 49158 (from 0)
>[2017-11-13 22:07:43.139644] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-17: changing port to 49155 (from 0)
>[2017-11-13 22:07:43.139662] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-27: changing port to 49157 (from 0)
>[2017-11-13 22:07:43.139674] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-23: changing port to 49156 (from 0)
>[2017-11-13 22:07:43.139686] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-28: changing port to 49158 (from 0)
>[2017-11-13 22:07:43.139698] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-29: changing port to 49158 (from 0)
>[2017-11-13 22:07:43.139710] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-36: changing port to 49159 (from 0)
>[2017-11-13 22:07:43.139726] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-34: changing port to 49160 (from 0)
>[2017-11-13 22:07:43.139739] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-33: changing port to 49159 (from 0)
>[2017-11-13 22:07:43.139750] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-32: changing port to 49158 (from 0)
>[2017-11-13 22:07:43.139762] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-13: changing port to 49155 (from 0)
>[2017-11-13 22:07:43.139774] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-35: changing port to 49159 (from 0)
>[2017-11-13 22:07:43.139786] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-38: changing port to 49159 (from 0)
>[2017-11-13 22:07:43.139798] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-42: changing port to 49160 (from 0)
>[2017-11-13 22:07:43.139813] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-19: changing port to 49156 (from 0)
>[2017-11-13 22:07:43.139826] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-39: changing port to 49160 (from 0)
>[2017-11-13 22:07:43.139837] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-40: changing port to 49161 (from 0)
>[2017-11-13 22:07:43.139857] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-8: Connected to gluster1-client-8, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:07:43.139864] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-8: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:08:23.036771] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-41: changing port to 49160 (from 0)
>[2017-11-13 22:08:23.036813] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-25: changing port to 49157 (from 0)
>[2017-11-13 22:08:23.036835] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-31: changing port to 49158 (from 0)
>[2017-11-13 22:08:23.036829] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-44: changing port to 49160 (from 0)
>[2017-11-13 22:08:23.036856] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-45: changing port to 49161 (from 0)
>[2017-11-13 22:08:23.036844] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-48: changing port to 49161 (from 0)
>[2017-11-13 22:08:23.036877] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-46: changing port to 49162 (from 0)
>[2017-11-13 22:08:23.036884] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-37: changing port to 49160 (from 0)
>[2017-11-13 22:08:23.036897] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-47: changing port to 49162 (from 0)
>[2017-11-13 22:08:23.036924] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-49: changing port to 49162 (from 0)
>[2017-11-13 22:08:23.036924] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-43: changing port to 49161 (from 0)
>[2017-11-13 22:08:23.036935] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-50: changing port to 49161 (from 0)
>[2017-11-13 22:08:23.036945] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-54: changing port to 49162 (from 0)
>[2017-11-13 22:08:23.036955] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-51: changing port to 49162 (from 0)
>[2017-11-13 22:08:23.036976] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-53: changing port to 49164 (from 0)
>[2017-11-13 22:08:23.036967] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-52: changing port to 49163 (from 0)
>[2017-11-13 22:08:23.036998] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-56: changing port to 49162 (from 0)
>[2017-11-13 22:08:23.037019] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-60: changing port to 49163 (from 0)
>[2017-11-13 22:08:23.037022] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-58: changing port to 49164 (from 0)
>[2017-11-13 22:08:23.037023] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-57: changing port to 49163 (from 0)
>[2017-11-13 22:08:23.037056] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-66: changing port to 49164 (from 0)
>[2017-11-13 22:08:23.037072] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-59: changing port to 49165 (from 0)
>[2017-11-13 22:08:23.037083] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-61: changing port to 49164 (from 0)
>[2017-11-13 22:08:23.037090] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-63: changing port to 49164 (from 0)
>[2017-11-13 22:08:23.037095] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-62: changing port to 49163 (from 0)
>[2017-11-13 22:08:23.037108] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-64: changing port to 49165 (from 0)
>[2017-11-13 22:08:23.037113] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-65: changing port to 49166 (from 0)
>[2017-11-13 22:08:23.037117] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-67: changing port to 49165 (from 0)
>[2017-11-13 22:08:23.037133] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-70: changing port to 49166 (from 0)
>[2017-11-13 22:08:23.037138] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-69: changing port to 49165 (from 0)
>[2017-11-13 22:08:23.037158] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-71: changing port to 49167 (from 0)
>[2017-11-13 22:08:23.037160] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-68: changing port to 49164 (from 0)
>[2017-11-13 22:08:23.037272] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-55: changing port to 49163 (from 0)
>[2017-11-13 22:08:23.098294] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-8: Server lk version = 1
>[2017-11-13 22:08:23.172186] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172258] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172298] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172337] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172371] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172406] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172441] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172479] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172510] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172544] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172584] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172618] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172653] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172669] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172699] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172732] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172757] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172771] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172806] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172810] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172855] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172855] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172894] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172901] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172940] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172947] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.172985] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173054] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173079] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173097] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173123] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173152] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173171] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-44: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173209] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-45: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173215] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-48: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173285] I [MSGID: 109063] [dht-layout.c:713:dht_layout_normalize] 0-gluster1-dht: Found anomalies in / (gfid = 00000000-0000-0000-0000-000000000001). Holes=2 overlaps=0
>[2017-11-13 22:08:23.173289] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173301] W [MSGID: 109005] [dht-selfheal.c:2111:dht_selfheal_directory] 0-gluster1-dht: Directory selfheal failed: 11 subvolumes down.Not fixing. path = /, gfid = 
>[2017-11-13 22:08:23.173355] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-46: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173392] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173412] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-47: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173433] I [MSGID: 104041] [glfs-resolve.c:970:__glfs_active_subvol] 0-gluster1: switched to graph 6e312e65-7861-6d70-6c65-2e636f6d2d32 (0)
>[2017-11-13 22:08:23.173462] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-49: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173464] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-50: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173509] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-54: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173519] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173559] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-53: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173576] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-52: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173601] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-51: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173619] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-56: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173644] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-60: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173657] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-58: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173696] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-57: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173700] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-66: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173735] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-59: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173759] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-61: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173773] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-63: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173800] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-62: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173811] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-64: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173854] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-67: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173854] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-65: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173895] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-70: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173908] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-69: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:08:23.173948] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-18: Connected to gluster1-client-18, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:08:23.173957] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-18: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:08:23.174003] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-24: Connected to gluster1-client-24, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:08:23.174013] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-24: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:08:23.174015] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-10: Connected to gluster1-client-10, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:08:23.174031] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-10: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:08:23.174066] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-1: Going UP
>[2017-11-13 22:08:23.175034] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-22: Connected to gluster1-client-22, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:08:23.175052] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-22: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:08:23.177360] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-12: Connected to gluster1-client-12, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:08:23.177382] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-12: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.215380] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-1: Executing operation with some subvolumes unavailable (28)
>[2017-11-13 22:09:03.216720] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-16: Connected to gluster1-client-16, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:09:03.216747] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-16: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216805] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-14: Connected to gluster1-client-14, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:09:03.216814] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-14: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216808] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-30: Connected to gluster1-client-30, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:09:03.216841] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-30: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216848] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-36: Connected to gluster1-client-36, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:09:03.216867] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-36: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216869] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-28: Connected to gluster1-client-28, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:09:03.216880] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-28: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216884] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-20: Connected to gluster1-client-20, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:09:03.216904] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-20: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216927] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-11: Connected to gluster1-client-11, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:09:03.216929] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-15: Connected to gluster1-client-15, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:09:03.216941] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-11: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216947] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-15: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216960] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-26: Connected to gluster1-client-26, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:09:03.216971] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-26: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.216975] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-17: Connected to gluster1-client-17, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:09:03.216979] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-2: Going UP
>[2017-11-13 22:09:03.216986] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-17: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:03.217002] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-21: Connected to gluster1-client-21, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:09:03.217012] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-21: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:05.961204] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-18: server 192.168.1.101:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:05.961681] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-24: server 192.168.1.101:49157 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:05.961727] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-10: server 192.168.1.105:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:05.961746] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-22: server 192.168.1.105:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:05.961762] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-12: server 192.168.1.101:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:07.962123] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-0: server 192.168.1.101:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:07.962215] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-1: server 192.168.1.102:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:07.962255] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-2: server 192.168.1.103:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:07.962273] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-3: server 192.168.1.104:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:07.962289] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-4: server 192.168.1.105:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:07.962312] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-5: server 192.168.1.106:49152 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:43.259373] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-2: Executing operation with some subvolumes unavailable (22)
>[2017-11-13 22:09:43.259420] I [socket.c:3585:socket_submit_request] 0-gluster1-client-12: not connected (priv->connected = -1)
>[2017-11-13 22:09:43.259427] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-12: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-12)
>[2017-11-13 22:09:43.259438] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-12: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:09:43.259574] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-34: Connected to gluster1-client-34, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:09:43.259583] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-34: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:43.259637] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-9: Connected to gluster1-client-9, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:09:43.259638] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-32: Connected to gluster1-client-32, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:09:43.259682] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-9: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:43.259692] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-32: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:43.259694] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-3: Going UP
>[2017-11-13 22:09:43.259708] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-27: Connected to gluster1-client-27, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:09:43.259740] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-27: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:09:45.969581] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-6: server 192.168.1.101:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969670] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-7: server 192.168.1.102:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969693] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-16: server 192.168.1.105:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969715] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-14: server 192.168.1.103:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969732] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-30: server 192.168.1.101:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969753] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-28: server 192.168.1.105:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969786] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-36: server 192.168.1.101:49159 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969810] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-20: server 192.168.1.103:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969827] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-15: server 192.168.1.104:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969843] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-11: server 192.168.1.106:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969859] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-26: server 192.168.1.103:49157 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969876] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-17: server 192.168.1.106:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:45.969891] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-21: server 192.168.1.104:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:09:47.970184] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-8: server 192.168.1.103:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:10:23.302830] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-3: Executing operation with some subvolumes unavailable (22)
>[2017-11-13 22:10:23.302870] I [socket.c:3585:socket_submit_request] 0-gluster1-client-18: not connected (priv->connected = -1)
>[2017-11-13 22:10:23.302877] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-18: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-18)
>[2017-11-13 22:10:23.302886] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-18: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:10:23.302910] I [socket.c:3585:socket_submit_request] 0-gluster1-client-20: not connected (priv->connected = -1)
>[2017-11-13 22:10:23.302915] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-20: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-20)
>[2017-11-13 22:10:23.302921] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-20: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:10:23.302944] I [socket.c:3585:socket_submit_request] 0-gluster1-client-21: not connected (priv->connected = -1)
>[2017-11-13 22:10:23.302949] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-21: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-21)
>[2017-11-13 22:10:23.302954] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-21: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:10:23.302969] I [socket.c:3585:socket_submit_request] 0-gluster1-client-22: not connected (priv->connected = -1)
>[2017-11-13 22:10:23.302973] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-22: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-22)
>[2017-11-13 22:10:23.302978] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-22: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:10:23.302993] W [MSGID: 109075] [dht-diskusage.c:44:dht_du_info_cbk] 0-gluster1-dht: failed to get disk info from gluster1-disperse-3 [Transport endpoint is not connected]
>[2017-11-13 22:10:23.303087] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-33: Connected to gluster1-client-33, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:10:23.303099] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-33: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:10:23.303138] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-5: Going UP
>[2017-11-13 22:10:23.303165] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-29: Connected to gluster1-client-29, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:10:23.303175] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-42: Connected to gluster1-client-42, attached to remote volume '/rhgs/bricks/brick8/gluster1'.
>[2017-11-13 22:10:23.303185] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-29: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:10:23.303201] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-42: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:10:25.977070] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-34: server 192.168.1.105:49160 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:10:25.977476] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-32: server 192.168.1.103:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:10:25.977513] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-9: server 192.168.1.104:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:10:25.977533] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-27: server 192.168.1.104:49157 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:11:03.344712] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-5: Executing operation with some subvolumes unavailable (22)
>[2017-11-13 22:11:03.344752] I [socket.c:3585:socket_submit_request] 0-gluster1-client-30: not connected (priv->connected = -1)
>[2017-11-13 22:11:03.344759] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-30: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-30)
>[2017-11-13 22:11:03.344767] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-30: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:11:03.344791] I [socket.c:3585:socket_submit_request] 0-gluster1-client-32: not connected (priv->connected = -1)
>[2017-11-13 22:11:03.344802] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-32: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-32)
>[2017-11-13 22:11:03.344808] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-32: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:11:03.344844] I [socket.c:3585:socket_submit_request] 0-gluster1-client-34: not connected (priv->connected = -1)
>[2017-11-13 22:11:03.344849] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-34: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-34)
>[2017-11-13 22:11:03.344854] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-34: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:11:03.344930] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-38: Connected to gluster1-client-38, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:11:03.344939] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-38: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:03.344943] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-4: Going UP
>[2017-11-13 22:11:05.984647] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-33: server 192.168.1.104:49159 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:11:05.984781] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-29: server 192.168.1.106:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:11:05.984829] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-42: server 192.168.1.101:49160 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:11:43.386526] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-4: Executing operation with some subvolumes unavailable (22)
>[2017-11-13 22:11:43.386565] I [socket.c:3585:socket_submit_request] 0-gluster1-client-24: not connected (priv->connected = -1)
>[2017-11-13 22:11:43.386572] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-24: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-24)
>[2017-11-13 22:11:43.386579] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-24: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:11:43.386606] I [socket.c:3585:socket_submit_request] 0-gluster1-client-26: not connected (priv->connected = -1)
>[2017-11-13 22:11:43.386611] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-26: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-26)
>[2017-11-13 22:11:43.386616] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-26: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:11:43.386631] I [socket.c:3585:socket_submit_request] 0-gluster1-client-27: not connected (priv->connected = -1)
>[2017-11-13 22:11:43.386636] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-27: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-27)
>[2017-11-13 22:11:43.386643] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-27: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:11:43.386655] I [socket.c:3585:socket_submit_request] 0-gluster1-client-28: not connected (priv->connected = -1)
>[2017-11-13 22:11:43.386659] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-28: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-28)
>[2017-11-13 22:11:43.386672] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-28: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:11:43.386686] W [MSGID: 109075] [dht-diskusage.c:44:dht_du_info_cbk] 0-gluster1-dht: failed to get disk info from gluster1-disperse-4 [Transport endpoint is not connected]
>[2017-11-13 22:11:43.386743] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-23: Connected to gluster1-client-23, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:11:43.386750] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-23: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.386821] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-35: Connected to gluster1-client-35, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:11:43.386849] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-35: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.386850] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-40: Connected to gluster1-client-40, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:11:43.386874] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-40: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.386886] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-13: Connected to gluster1-client-13, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:11:43.386908] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-13: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.386910] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-19: Connected to gluster1-client-19, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:11:43.386922] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-19: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.386926] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-39: Connected to gluster1-client-39, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:11:43.386945] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-39: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.386947] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-45: Connected to gluster1-client-45, attached to remote volume '/rhgs/bricks/brick8/gluster1'.
>[2017-11-13 22:11:43.386958] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-45: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.386971] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-44: Connected to gluster1-client-44, attached to remote volume '/rhgs/bricks/brick8/gluster1'.
>[2017-11-13 22:11:43.386979] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-44: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.386990] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-6: Going UP
>[2017-11-13 22:11:43.386989] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-41: Connected to gluster1-client-41, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:11:43.387008] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-41: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:43.387010] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-48: Connected to gluster1-client-48, attached to remote volume '/rhgs/bricks/brick9/gluster1'.
>[2017-11-13 22:11:43.387036] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-48: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:11:45.992230] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-38: server 192.168.1.103:49159 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:23.428014] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-6: Executing operation with some subvolumes unavailable (22)
>[2017-11-13 22:12:23.428073] I [socket.c:3585:socket_submit_request] 0-gluster1-client-36: not connected (priv->connected = -1)
>[2017-11-13 22:12:23.428080] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-36: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-36)
>[2017-11-13 22:12:23.428088] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-36: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:12:23.428113] I [socket.c:3585:socket_submit_request] 0-gluster1-client-38: not connected (priv->connected = -1)
>[2017-11-13 22:12:23.428118] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-38: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-38)
>[2017-11-13 22:12:23.428124] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-38: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:12:23.429500] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-37: Connected to gluster1-client-37, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:12:23.429516] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-37: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:12:23.429587] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-31: Connected to gluster1-client-31, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:12:23.429589] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-25: Connected to gluster1-client-25, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:12:23.429602] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-47: Connected to gluster1-client-47, attached to remote volume '/rhgs/bricks/brick8/gluster1'.
>[2017-11-13 22:12:23.429614] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-25: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:12:23.429599] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-31: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:12:23.429628] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-47: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:12:23.429638] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-50: Connected to gluster1-client-50, attached to remote volume '/rhgs/bricks/brick9/gluster1'.
>[2017-11-13 22:12:23.429658] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-50: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:12:23.429673] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-54: Connected to gluster1-client-54, attached to remote volume '/rhgs/bricks/brick10/gluster1'.
>[2017-11-13 22:12:23.429683] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-54: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:12:23.429695] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-7: Going UP
>[2017-11-13 22:12:23.429772] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-49: Connected to gluster1-client-49, attached to remote volume '/rhgs/bricks/brick9/gluster1'.
>[2017-11-13 22:12:23.429798] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-49: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:12:25.998997] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-23: server 192.168.1.106:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999156] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-35: server 192.168.1.106:49159 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999205] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-40: server 192.168.1.105:49161 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999254] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-19: server 192.168.1.102:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999270] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-13: server 192.168.1.102:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999286] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-45: server 192.168.1.104:49161 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999302] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-39: server 192.168.1.104:49160 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999317] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-44: server 192.168.1.103:49160 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999333] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-41: server 192.168.1.106:49160 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:12:25.999348] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-48: server 192.168.1.101:49161 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:13:03.472259] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-7: Executing operation with some subvolumes unavailable (12)
>[2017-11-13 22:13:03.472320] I [socket.c:3585:socket_submit_request] 0-gluster1-client-42: not connected (priv->connected = -1)
>[2017-11-13 22:13:03.472328] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-42: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-42)
>[2017-11-13 22:13:03.472337] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-42: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:13:03.472362] I [socket.c:3585:socket_submit_request] 0-gluster1-client-44: not connected (priv->connected = -1)
>[2017-11-13 22:13:03.472368] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-44: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-44)
>[2017-11-13 22:13:03.472374] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-44: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:13:03.472391] I [socket.c:3585:socket_submit_request] 0-gluster1-client-45: not connected (priv->connected = -1)
>[2017-11-13 22:13:03.472396] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-45: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-45)
>[2017-11-13 22:13:03.472402] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-45: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:13:03.472531] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-53: Connected to gluster1-client-53, attached to remote volume '/rhgs/bricks/brick9/gluster1'.
>[2017-11-13 22:13:03.472555] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-53: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:13:03.472610] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-52: Connected to gluster1-client-52, attached to remote volume '/rhgs/bricks/brick9/gluster1'.
>[2017-11-13 22:13:03.472639] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-52: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:13:03.472643] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-46: Connected to gluster1-client-46, attached to remote volume '/rhgs/bricks/brick8/gluster1'.
>[2017-11-13 22:13:03.472656] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-46: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:13:03.472648] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-8: Going UP
>[2017-11-13 22:13:03.472686] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-43: Connected to gluster1-client-43, attached to remote volume '/rhgs/bricks/brick8/gluster1'.
>[2017-11-13 22:13:03.472710] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-43: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:13:05.653992] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-37: server 192.168.1.102:49160 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:13:05.654545] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-31: server 192.168.1.102:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:13:05.654567] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-25: server 192.168.1.102:49157 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:13:05.654583] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-47: server 192.168.1.106:49162 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:13:05.654600] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-50: server 192.168.1.103:49161 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:13:05.654614] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-54: server 192.168.1.101:49162 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:13:05.654639] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-49: server 192.168.1.102:49162 has not responded in the last 42 seconds, disconnecting.

Actions: View

Attachments on bug 1513736: 1353008 | 1353009