Attachment 1353008 Details for Bug 1513736 – Output from 1460514 test program

Output from 1460514 test program

1460514.log (text/plain), 63.75 KB, created by Dustin Black on 2017-11-15 21:37:17 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Dustin Black

Created: 2017-11-15 21:37:17 UTC

Size: 63.75 KB

patch

obsolete

>[2017-11-13 22:14:01.306501] E [socket.c:2360:socket_connect_finish] 0-gfapi: connection to ::1%1:24007 failed (Connection refused); disconnecting socket
>[2017-11-13 22:14:01.306560] I [MSGID: 104024] [glfs-mgmt.c:801:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
>[2017-11-13 22:14:05.289043] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-gluster1-readdir-ahead: option 'parallel-readdir' is not recognized
>[2017-11-13 22:14:05.289854] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 6e312e65-7861-6d70-6c65-2e636f6d2d32 (0) coming up
>[2017-11-13 22:14:05.289872] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-0: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.292417] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-1: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.292858] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-0: changing port to 49153 (from 0)
>[2017-11-13 22:14:05.294509] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-2: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.294827] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-1: changing port to 49153 (from 0)
>[2017-11-13 22:14:05.297278] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.298238] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-0: Connected to gluster1-client-0, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:14:05.298265] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-0: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:05.298372] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-0: Server lk version = 1
>[2017-11-13 22:14:05.299421] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-3: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.299830] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-2: changing port to 49153 (from 0)
>[2017-11-13 22:14:05.301780] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.302278] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-1: Connected to gluster1-client-1, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:14:05.302291] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-1: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:05.302398] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-1: Server lk version = 1
>[2017-11-13 22:14:05.303560] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-4: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.303951] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-3: changing port to 49153 (from 0)
>[2017-11-13 22:14:05.305885] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.306437] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-2: Connected to gluster1-client-2, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:14:05.306450] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-2: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:05.306569] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-2: Server lk version = 1
>[2017-11-13 22:14:05.307723] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-5: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.308092] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-4: changing port to 49153 (from 0)
>[2017-11-13 22:14:05.310264] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.310809] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-3: Connected to gluster1-client-3, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:14:05.310821] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-3: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:05.310932] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-3: Server lk version = 1
>[2017-11-13 22:14:05.311890] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-6: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.312205] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-5: changing port to 49152 (from 0)
>[2017-11-13 22:14:05.314277] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.314685] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-4: Connected to gluster1-client-4, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:14:05.314695] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-4: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:05.314811] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-4: Server lk version = 1
>[2017-11-13 22:14:05.315998] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-7: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.316209] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-6: changing port to 49154 (from 0)
>[2017-11-13 22:14:05.318407] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.318828] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-5: Connected to gluster1-client-5, attached to remote volume '/rhgs/bricks/brick1/gluster1'.
>[2017-11-13 22:14:05.318839] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-5: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:05.318864] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-0: Going UP
>[2017-11-13 22:14:05.318961] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-5: Server lk version = 1
>[2017-11-13 22:14:05.320204] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-8: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.320455] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-7: changing port to 49154 (from 0)
>[2017-11-13 22:14:05.322345] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.322820] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-6: Connected to gluster1-client-6, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:14:05.322832] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-6: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:05.324414] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-9: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.326578] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-6: Server lk version = 1
>[2017-11-13 22:14:05.326833] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.326876] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-8: changing port to 49154 (from 0)
>[2017-11-13 22:14:05.328539] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-10: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.330728] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-7: Connected to gluster1-client-7, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:14:05.330746] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-7: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:05.332900] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-11: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.334957] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-12: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.336951] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-13: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.339107] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-14: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.341273] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-15: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.343386] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-16: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.345601] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-17: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.347699] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-18: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.349790] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-19: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.351856] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-20: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.353820] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-21: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.355784] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-22: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.357748] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-23: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.359713] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-24: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.361703] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-25: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.363852] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-26: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.365863] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-27: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.367837] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-28: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.369804] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-29: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.371775] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-30: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.373759] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-31: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.375849] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-32: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.377933] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-33: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.379942] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-34: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.382062] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-35: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.384114] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-36: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.386102] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-37: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.388083] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-38: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.390100] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-39: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.392166] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-40: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.394142] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-41: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.396119] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-42: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.398115] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-43: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.400190] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-44: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.402169] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-45: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.404150] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-46: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.406130] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-47: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.408114] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-48: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.410114] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-49: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.412261] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-50: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.414328] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-51: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.416308] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-52: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.418289] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-53: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.420274] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-54: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.422273] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-55: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.424412] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-56: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.426446] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-57: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.428430] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-58: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.430465] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-59: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.432588] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-60: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.434627] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-61: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.436738] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-62: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.438718] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-63: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.440836] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-64: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.442843] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-65: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.444833] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-66: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.446839] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-67: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.448938] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-68: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.450924] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-69: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.453043] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-70: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.455044] I [MSGID: 114020] [client.c:2356:notify] 0-gluster1-client-71: parent translators are ready, attempting connect on transport
>[2017-11-13 22:14:05.457150] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-7: Server lk version = 1
>[2017-11-13 22:14:05.457973] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:05.458787] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-9: changing port to 49154 (from 0)
>[2017-11-13 22:14:05.458808] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-12: changing port to 49155 (from 0)
>[2017-11-13 22:14:05.458825] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-11: changing port to 49153 (from 0)
>[2017-11-13 22:14:05.458838] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-10: changing port to 49154 (from 0)
>[2017-11-13 22:14:05.458850] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-15: changing port to 49155 (from 0)
>[2017-11-13 22:14:05.458862] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-18: changing port to 49156 (from 0)
>[2017-11-13 22:14:05.458878] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-16: changing port to 49155 (from 0)
>[2017-11-13 22:14:05.458890] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-24: changing port to 49157 (from 0)
>[2017-11-13 22:14:05.458905] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-17: changing port to 49155 (from 0)
>[2017-11-13 22:14:05.458918] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-21: changing port to 49156 (from 0)
>[2017-11-13 22:14:05.458930] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-14: changing port to 49155 (from 0)
>[2017-11-13 22:14:05.458941] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-22: changing port to 49156 (from 0)
>[2017-11-13 22:14:05.458953] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-23: changing port to 49156 (from 0)
>[2017-11-13 22:14:05.458966] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-20: changing port to 49156 (from 0)
>[2017-11-13 22:14:05.458977] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-13: changing port to 49155 (from 0)
>[2017-11-13 22:14:05.458995] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-30: changing port to 49158 (from 0)
>[2017-11-13 22:14:05.459011] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-19: changing port to 49156 (from 0)
>[2017-11-13 22:14:05.459023] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-27: changing port to 49157 (from 0)
>[2017-11-13 22:14:05.459044] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-26: changing port to 49157 (from 0)
>[2017-11-13 22:14:05.459056] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-25: changing port to 49157 (from 0)
>[2017-11-13 22:14:05.459068] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-28: changing port to 49158 (from 0)
>[2017-11-13 22:14:05.459081] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-31: changing port to 49158 (from 0)
>[2017-11-13 22:14:05.459093] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-32: changing port to 49158 (from 0)
>[2017-11-13 22:14:05.459105] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-36: changing port to 49159 (from 0)
>[2017-11-13 22:14:05.459128] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-8: Connected to gluster1-client-8, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:14:05.459136] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-8: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:46.076695] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-33: changing port to 49159 (from 0)
>[2017-11-13 22:14:46.076737] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-29: changing port to 49158 (from 0)
>[2017-11-13 22:14:46.076782] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-35: changing port to 49159 (from 0)
>[2017-11-13 22:14:46.076781] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-34: changing port to 49160 (from 0)
>[2017-11-13 22:14:46.076806] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-37: changing port to 49160 (from 0)
>[2017-11-13 22:14:46.076829] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-42: changing port to 49160 (from 0)
>[2017-11-13 22:14:46.076829] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-38: changing port to 49159 (from 0)
>[2017-11-13 22:14:46.076844] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-40: changing port to 49161 (from 0)
>[2017-11-13 22:14:46.076874] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-39: changing port to 49160 (from 0)
>[2017-11-13 22:14:46.076895] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-48: changing port to 49161 (from 0)
>[2017-11-13 22:14:46.076906] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-43: changing port to 49161 (from 0)
>[2017-11-13 22:14:46.076913] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-44: changing port to 49160 (from 0)
>[2017-11-13 22:14:46.076917] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-41: changing port to 49160 (from 0)
>[2017-11-13 22:14:46.076929] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-47: changing port to 49162 (from 0)
>[2017-11-13 22:14:46.076929] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-46: changing port to 49162 (from 0)
>[2017-11-13 22:14:46.076960] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-49: changing port to 49162 (from 0)
>[2017-11-13 22:14:46.076966] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-50: changing port to 49161 (from 0)
>[2017-11-13 22:14:46.076959] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-45: changing port to 49161 (from 0)
>[2017-11-13 22:14:46.076986] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-51: changing port to 49162 (from 0)
>[2017-11-13 22:14:46.076989] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-53: changing port to 49164 (from 0)
>[2017-11-13 22:14:46.077001] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-60: changing port to 49163 (from 0)
>[2017-11-13 22:14:46.076949] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-54: changing port to 49162 (from 0)
>[2017-11-13 22:14:46.077008] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-52: changing port to 49163 (from 0)
>[2017-11-13 22:14:46.077006] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-55: changing port to 49163 (from 0)
>[2017-11-13 22:14:46.077052] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-56: changing port to 49162 (from 0)
>[2017-11-13 22:14:46.077086] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-66: changing port to 49164 (from 0)
>[2017-11-13 22:14:46.077093] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-59: changing port to 49165 (from 0)
>[2017-11-13 22:14:46.077097] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-57: changing port to 49163 (from 0)
>[2017-11-13 22:14:46.077108] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-62: changing port to 49163 (from 0)
>[2017-11-13 22:14:46.077117] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-63: changing port to 49164 (from 0)
>[2017-11-13 22:14:46.077115] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-65: changing port to 49166 (from 0)
>[2017-11-13 22:14:46.077115] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-61: changing port to 49164 (from 0)
>[2017-11-13 22:14:46.077137] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-58: changing port to 49164 (from 0)
>[2017-11-13 22:14:46.077142] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-68: changing port to 49164 (from 0)
>[2017-11-13 22:14:46.077148] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-67: changing port to 49165 (from 0)
>[2017-11-13 22:14:46.077143] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-64: changing port to 49165 (from 0)
>[2017-11-13 22:14:46.077165] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-69: changing port to 49165 (from 0)
>[2017-11-13 22:14:46.077170] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-70: changing port to 49166 (from 0)
>[2017-11-13 22:14:46.077174] I [rpc-clnt.c:2001:rpc_clnt_reconfig] 0-gluster1-client-71: changing port to 49167 (from 0)
>[2017-11-13 22:14:46.124840] I [MSGID: 114035] [client-handshake.c:201:client_set_lk_version_cbk] 0-gluster1-client-8: Server lk version = 1
>[2017-11-13 22:14:46.214110] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214168] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214206] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214240] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214276] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214313] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214346] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214376] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214409] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214443] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214484] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214520] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214553] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214586] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214619] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214650] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214682] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214712] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214745] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214776] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214809] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214873] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214923] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.214994] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215033] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215074] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215103] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215135] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215167] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215198] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215230] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215259] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215281] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215298] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-48: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215343] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215383] I [MSGID: 109063] [dht-layout.c:713:dht_layout_normalize] 0-gluster1-dht: Found anomalies in / (gfid = 00000000-0000-0000-0000-000000000001). Holes=2 overlaps=0
>[2017-11-13 22:14:46.215392] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215408] W [MSGID: 109005] [dht-selfheal.c:2111:dht_selfheal_directory] 0-gluster1-dht: Directory selfheal failed: 11 subvolumes down.Not fixing. path = /, gfid = 
>[2017-11-13 22:14:46.215431] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-47: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215465] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-46: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215499] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-49: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215508] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-44: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215540] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-45: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215541] I [MSGID: 104041] [glfs-resolve.c:970:__glfs_active_subvol] 0-gluster1: switched to graph 6e312e65-7861-6d70-6c65-2e636f6d2d32 (0)
>[2017-11-13 22:14:46.215576] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-51: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215582] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-53: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215629] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-50: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215641] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-52: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215679] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-60: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215677] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-55: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215722] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-59: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215725] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-66: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215760] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-54: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215770] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-56: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215805] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-57: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215824] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-63: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215846] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-65: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215863] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-62: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215882] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-58: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215900] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-61: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215925] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-67: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215944] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-64: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215965] I [MSGID: 114057] [client-handshake.c:1450:select_server_supported_programs] 0-gluster1-client-68: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2017-11-13 22:14:46.215996] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-24: Connected to gluster1-client-24, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:14:46.216008] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-24: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:46.216017] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-12: Connected to gluster1-client-12, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:14:46.216037] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-12: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:46.216075] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-10: Connected to gluster1-client-10, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:14:46.216088] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-10: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:46.216116] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-22: Connected to gluster1-client-22, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:14:46.216132] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-22: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:46.216133] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-1: Going UP
>[2017-11-13 22:14:46.217582] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-18: Connected to gluster1-client-18, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:14:46.217600] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-18: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:14:46.219917] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-16: Connected to gluster1-client-16, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:14:46.219938] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-16: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.258810] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-1: Executing operation with some subvolumes unavailable (28)
>[2017-11-13 22:15:26.259006] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-21: Connected to gluster1-client-21, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:15:26.259017] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-21: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.259092] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-13: Connected to gluster1-client-13, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:15:26.259101] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-30: Connected to gluster1-client-30, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:15:26.259121] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-13: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.259126] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-30: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.259122] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-11: Connected to gluster1-client-11, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:15:26.259143] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-11: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.259092] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-15: Connected to gluster1-client-15, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:15:26.259177] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-15: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.259188] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-9: Connected to gluster1-client-9, attached to remote volume '/rhgs/bricks/brick2/gluster1'.
>[2017-11-13 22:15:26.259199] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-9: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.259200] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-17: Connected to gluster1-client-17, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:15:26.259212] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-17: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.259220] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-27: Connected to gluster1-client-27, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:15:26.259235] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-27: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:26.259237] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-2: Going UP
>[2017-11-13 22:15:26.259245] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-25: Connected to gluster1-client-25, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:15:26.259254] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-25: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:15:29.066445] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-24: server 192.168.1.101:49157 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:29.066824] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-12: server 192.168.1.101:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:29.066866] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-10: server 192.168.1.105:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:29.066898] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-22: server 192.168.1.105:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:29.066914] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-18: server 192.168.1.101:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:29.066936] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-16: server 192.168.1.105:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:30.067177] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-0: server 192.168.1.101:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:30.067283] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-1: server 192.168.1.102:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:30.067318] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-2: server 192.168.1.103:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:30.067350] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-3: server 192.168.1.104:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:30.067373] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-4: server 192.168.1.105:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:15:30.067389] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-5: server 192.168.1.106:49152 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:06.291753] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-2: Executing operation with some subvolumes unavailable (24)
>[2017-11-13 22:16:06.291800] I [socket.c:3585:socket_submit_request] 0-gluster1-client-12: not connected (priv->connected = -1)
>[2017-11-13 22:16:06.291808] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-12: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-12)
>[2017-11-13 22:16:06.291817] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-12: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:16:06.293219] I [socket.c:3585:socket_submit_request] 0-gluster1-client-16: not connected (priv->connected = -1)
>[2017-11-13 22:16:06.293232] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-16: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-16)
>[2017-11-13 22:16:06.293242] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-16: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:16:06.293338] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-19: Connected to gluster1-client-19, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:16:06.293348] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-19: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:16:06.293376] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-14: Connected to gluster1-client-14, attached to remote volume '/rhgs/bricks/brick3/gluster1'.
>[2017-11-13 22:16:06.293406] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-14: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:16:06.293386] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-3: Going UP
>[2017-11-13 22:16:06.293419] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-28: Connected to gluster1-client-28, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:16:06.293452] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-28: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:16:09.074288] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-6: server 192.168.1.101:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074437] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-7: server 192.168.1.102:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074492] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-21: server 192.168.1.104:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074534] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-30: server 192.168.1.101:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074587] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-13: server 192.168.1.102:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074643] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-11: server 192.168.1.106:49153 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074658] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-15: server 192.168.1.104:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074675] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-9: server 192.168.1.104:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074690] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-17: server 192.168.1.106:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074706] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-27: server 192.168.1.104:49157 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:09.074721] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-25: server 192.168.1.102:49157 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:11.074998] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-8: server 192.168.1.103:49154 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:46.329505] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-3: Executing operation with some subvolumes unavailable (24)
>[2017-11-13 22:16:46.329547] I [socket.c:3585:socket_submit_request] 0-gluster1-client-18: not connected (priv->connected = -1)
>[2017-11-13 22:16:46.329555] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-18: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-18)
>[2017-11-13 22:16:46.329563] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-18: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:16:46.329614] I [socket.c:3585:socket_submit_request] 0-gluster1-client-21: not connected (priv->connected = -1)
>[2017-11-13 22:16:46.329619] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-21: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-21)
>[2017-11-13 22:16:46.329624] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-21: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:16:46.329640] I [socket.c:3585:socket_submit_request] 0-gluster1-client-22: not connected (priv->connected = -1)
>[2017-11-13 22:16:46.329645] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-22: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-22)
>[2017-11-13 22:16:46.329658] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-22: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:16:46.329736] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-23: Connected to gluster1-client-23, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:16:46.329744] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-23: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:16:46.329793] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-31: Connected to gluster1-client-31, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:16:46.329821] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-31: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:16:46.329795] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-36: Connected to gluster1-client-36, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:16:46.329849] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-36: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:16:46.329850] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-4: Going UP
>[2017-11-13 22:16:46.329907] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-26: Connected to gluster1-client-26, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:16:46.329924] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-26: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:16:49.661237] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-19: server 192.168.1.102:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:49.661303] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-14: server 192.168.1.103:49155 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:16:49.661324] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-28: server 192.168.1.105:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:17:26.370396] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-4: Executing operation with some subvolumes unavailable (24)
>[2017-11-13 22:17:26.370442] I [socket.c:3585:socket_submit_request] 0-gluster1-client-24: not connected (priv->connected = -1)
>[2017-11-13 22:17:26.370450] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-24: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-24)
>[2017-11-13 22:17:26.370458] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-24: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:17:26.370482] I [socket.c:3585:socket_submit_request] 0-gluster1-client-25: not connected (priv->connected = -1)
>[2017-11-13 22:17:26.370488] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-25: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-25)
>[2017-11-13 22:17:26.370494] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-25: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:17:26.370509] I [socket.c:3585:socket_submit_request] 0-gluster1-client-27: not connected (priv->connected = -1)
>[2017-11-13 22:17:26.370514] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-27: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-27)
>[2017-11-13 22:17:26.370520] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-27: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:17:26.370539] I [socket.c:3585:socket_submit_request] 0-gluster1-client-28: not connected (priv->connected = -1)
>[2017-11-13 22:17:26.370544] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-28: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-28)
>[2017-11-13 22:17:26.370548] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-28: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:17:26.370565] W [MSGID: 109075] [dht-diskusage.c:44:dht_du_info_cbk] 0-gluster1-dht: failed to get disk info from gluster1-disperse-4 [Transport endpoint is not connected]
>[2017-11-13 22:17:26.370649] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-20: Connected to gluster1-client-20, attached to remote volume '/rhgs/bricks/brick4/gluster1'.
>[2017-11-13 22:17:26.370657] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-20: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:17:26.370717] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-32: Connected to gluster1-client-32, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:17:26.370725] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-32: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:17:26.370726] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-37: Connected to gluster1-client-37, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:17:26.370726] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-33: Connected to gluster1-client-33, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:17:26.370757] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-37: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:17:26.370762] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-33: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:17:26.370774] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-39: Connected to gluster1-client-39, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:17:26.370787] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-39: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:17:26.370792] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-40: Connected to gluster1-client-40, attached to remote volume '/rhgs/bricks/brick7/gluster1'.
>[2017-11-13 22:17:26.370818] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-40: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:17:26.370838] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-29: Connected to gluster1-client-29, attached to remote volume '/rhgs/bricks/brick5/gluster1'.
>[2017-11-13 22:17:26.370835] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-5: Going UP
>[2017-11-13 22:17:26.370851] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-29: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:17:26.370869] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-35: Connected to gluster1-client-35, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:17:26.370889] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-35: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:17:28.668400] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-23: server 192.168.1.106:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:17:28.668857] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-31: server 192.168.1.102:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:17:28.668885] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-36: server 192.168.1.101:49159 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:17:28.668919] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-26: server 192.168.1.103:49157 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:18:06.412884] W [MSGID: 122035] [ec-common.c:464:ec_child_select] 0-gluster1-disperse-5: Executing operation with some subvolumes unavailable (30)
>[2017-11-13 22:18:06.412977] I [socket.c:3585:socket_submit_request] 0-gluster1-client-30: not connected (priv->connected = -1)
>[2017-11-13 22:18:06.412984] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-30: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-30)
>[2017-11-13 22:18:06.412991] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-30: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:18:06.413013] I [socket.c:3585:socket_submit_request] 0-gluster1-client-31: not connected (priv->connected = -1)
>[2017-11-13 22:18:06.413018] W [rpc-clnt.c:1694:rpc_clnt_submit] 0-gluster1-client-31: failed to submit rpc-request (XID: 0x7 Program: GlusterFS 3.3, ProgVers: 330, Proc: 14) to rpc-transport (gluster1-client-31)
>[2017-11-13 22:18:06.413024] W [MSGID: 114031] [client-rpc-fops.c:799:client3_3_statfs_cbk] 0-gluster1-client-31: remote operation failed [Transport endpoint is not connected]
>[2017-11-13 22:18:06.413152] I [MSGID: 114046] [client-handshake.c:1215:client_setvolume_cbk] 0-gluster1-client-34: Connected to gluster1-client-34, attached to remote volume '/rhgs/bricks/brick6/gluster1'.
>[2017-11-13 22:18:06.413161] I [MSGID: 114047] [client-handshake.c:1226:client_setvolume_cbk] 0-gluster1-client-34: Server and Client lk-version numbers are not same, reopening the fds
>[2017-11-13 22:18:06.413181] I [MSGID: 122061] [ec.c:323:ec_up] 0-gluster1-disperse-6: Going UP
>[2017-11-13 22:18:08.675973] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-20: server 192.168.1.103:49156 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:18:08.676130] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-32: server 192.168.1.103:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:18:08.676181] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-37: server 192.168.1.102:49160 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:18:08.676222] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-33: server 192.168.1.104:49159 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:18:08.676274] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-39: server 192.168.1.104:49160 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:18:08.676289] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-40: server 192.168.1.105:49161 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:18:08.676305] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-29: server 192.168.1.106:49158 has not responded in the last 42 seconds, disconnecting.
>[2017-11-13 22:18:08.676321] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-gluster1-client-35: server 192.168.1.106:49159 has not responded in the last 42 seconds, disconnecting.

Actions: View

Attachments on bug 1513736: 1353008 | 1353009