Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 659336 Details for
Bug 885072
Fuse mount for a stripe volume (1x8) fails.
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
mount logs
store-glusterMount-automation-volume-stripe.log (text/x-log), 202.32 KB, created by
Shruti Sampat
on 2012-12-07 12:27:05 UTC
(
hide
)
Description:
mount logs
Filename:
MIME Type:
Creator:
Shruti Sampat
Created:
2012-12-07 12:27:05 UTC
Size:
202.32 KB
patch
obsolete
>[2012-12-07 08:19:23.125942] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 08:19:23.191847] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 08:19:23.191994] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 08:19:23.226392] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 08:19:23.229963] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 08:19:23.233816] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 08:19:23.239523] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 08:19:23.244789] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 08:19:23.248126] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 08:19:23.251841] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 08:19:23.255256] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 08:19:23.260125] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 08:19:23.260227] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 08:19:23.260267] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 08:19:23.260311] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 08:19:23.260518] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 08:19:23.260567] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 08:19:23.260601] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 08:19:23.260730] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 08:19:27.150736] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 08:19:27.151325] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 08:19:27.151349] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 08:19:27.151906] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 08:19:27.154924] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 08:19:27.155620] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 08:19:27.155643] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 08:19:27.156214] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 08:19:27.158854] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 08:19:27.159534] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 08:19:27.159572] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 08:19:27.160100] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 08:19:27.162651] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 08:19:27.163425] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 08:19:27.163455] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 08:19:27.164089] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 08:19:27.166573] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 08:19:27.193216] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 08:19:27.193422] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 08:19:27.193484] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 08:19:27.193747] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 08:19:27.193892] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 08:19:27.201596] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-7: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 08:19:27.203459] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 08:19:27.203500] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 08:19:27.213728] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 08:19:27.214086] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 08:19:27.214161] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 09:11:46.752487] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 09:11:46.795979] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 09:11:46.796107] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 09:11:46.803646] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 09:11:46.814275] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 09:11:46.817592] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 09:11:46.820859] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 09:11:46.824806] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 09:11:46.828111] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 09:11:46.832084] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 09:11:46.835460] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 09:11:46.840029] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 09:11:46.840333] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 09:11:46.840413] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 09:11:46.840449] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 09:11:46.840508] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 09:11:46.840601] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 09:11:46.840646] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 09:11:46.840759] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 09:11:50.780476] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:11:50.781449] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 09:11:50.781502] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:11:50.782285] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 09:11:50.785750] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:11:50.786515] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 09:11:50.786567] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:11:50.787230] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 09:11:50.788762] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:11:50.789415] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 09:11:50.789455] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:11:50.790127] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 09:11:50.792271] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:11:50.792944] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 09:11:50.792997] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:11:50.793556] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 09:11:50.795015] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 09:11:50.801630] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 09:11:50.801923] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 09:11:50.801998] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 09:11:50.802305] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 09:11:50.802475] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:11:50.814344] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:11:50.814407] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 09:11:50.819118] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 09:11:50.819409] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 09:11:50.819439] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 09:14:07.971837] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 09:14:07.983621] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 09:14:07.983804] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 09:14:07.993034] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 09:14:07.996707] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 09:14:08.000137] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 09:14:08.003525] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 09:14:08.006931] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 09:14:08.010310] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 09:14:08.014589] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 09:14:08.017975] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 09:14:08.022785] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 09:14:08.022918] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 09:14:08.023404] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 09:14:08.023551] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 09:14:08.023657] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 09:14:08.023820] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 09:14:08.023946] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 09:14:08.024022] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 09:14:11.985572] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:14:11.986262] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 09:14:11.986302] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:14:11.986928] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 09:14:11.988751] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 09:14:11.994455] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 09:14:11.995137] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 09:14:11.995239] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:14:11.995465] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:14:11.995560] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:14:11.995607] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 09:14:11.995966] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 09:14:11.995989] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:14:11.996454] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 09:14:12.003117] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 09:14:12.004080] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 09:14:12.004111] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 09:28:50.365458] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 09:28:50.392961] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 09:28:50.393066] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 09:28:50.399698] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 09:28:50.403628] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 09:28:50.407119] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 09:28:50.410556] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 09:28:50.413931] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 09:28:50.417309] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 09:28:50.420667] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 09:28:50.424077] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 09:28:50.429077] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 09:28:50.429229] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 09:28:50.429371] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 09:28:50.429448] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 09:28:50.429593] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 09:28:50.429801] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 09:28:50.429934] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 09:28:50.430011] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 09:28:54.396000] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:28:54.396518] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 09:28:54.396543] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:28:54.396961] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 09:28:54.400203] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:28:54.400806] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 09:28:54.400831] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:28:54.401382] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 09:28:54.404029] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:28:54.404606] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 09:28:54.404629] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:28:54.405133] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 09:28:54.407786] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:28:54.408399] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 09:28:54.408422] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:28:54.408923] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 09:29:15.410841] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 09:29:15.415793] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 09:29:15.415959] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 09:29:15.416826] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 09:29:15.417155] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:29:15.419443] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:29:15.419497] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 09:29:15.419709] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 09:29:15.424738] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-7: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 09:29:15.426226] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 09:29:15.426730] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 09:29:15.426778] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 09:30:12.166790] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 09:30:12.186219] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 09:30:12.186320] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 09:30:12.192820] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 09:30:12.196533] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 09:30:12.199904] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 09:30:12.203237] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 09:30:12.206600] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 09:30:12.209999] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 09:30:12.213330] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 09:30:12.216708] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 09:30:12.221181] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 09:30:12.221267] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 09:30:12.221422] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 09:30:12.221510] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 09:30:12.221581] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 09:30:12.221616] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 09:30:12.221654] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 09:30:12.221777] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 09:30:16.201141] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:30:16.201866] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 09:30:16.201891] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:30:16.202520] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 09:30:16.204922] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:30:16.205471] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 09:30:16.205496] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:30:16.206007] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 09:30:16.208797] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:30:16.209358] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 09:30:16.209381] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:30:16.209883] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 09:30:16.212757] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:30:16.213358] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 09:30:16.213382] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:30:16.213937] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 09:30:37.186851] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 09:30:37.192812] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 09:30:37.193508] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 09:30:37.193585] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 09:30:37.193852] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 09:30:37.194136] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:30:37.196731] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-7: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 09:30:37.200908] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:30:37.201002] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 09:30:37.214272] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 09:30:37.218719] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 09:30:37.218777] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 09:40:39.654828] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 09:40:39.664520] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 09:40:39.664608] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 09:40:39.670664] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 09:40:39.674222] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 09:40:39.677537] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 09:40:39.680867] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 09:40:39.684232] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 09:40:39.687524] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 09:40:39.690817] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 09:40:39.694186] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 09:40:39.698996] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 09:40:39.699209] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 09:40:39.699353] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 09:40:39.699550] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 09:40:39.699646] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 09:40:39.699810] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 09:40:39.699935] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 09:40:39.700009] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 09:40:43.666752] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 09:40:43.670637] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 09:40:43.671228] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 09:40:43.671413] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 09:40:43.671520] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:40:43.671709] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:40:43.671755] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 09:40:43.674091] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:40:43.674771] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 09:40:43.674799] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:40:43.675263] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 09:40:43.677176] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 09:40:43.677636] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:40:43.677894] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 09:40:43.678251] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 09:40:43.678378] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:40:43.678471] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 09:42:51.263414] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 09:42:51.273855] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 09:42:51.273997] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 09:42:51.280138] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 09:42:51.283758] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 09:42:51.289057] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 09:42:51.294467] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 09:42:51.297804] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 09:42:51.301209] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 09:42:51.304588] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 09:42:51.311460] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 09:42:51.316776] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 09:42:51.316998] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 09:42:51.317184] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 09:42:51.317259] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 09:42:51.318028] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 09:42:51.318208] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 09:42:51.318333] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 09:42:51.318501] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 09:42:55.275995] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:42:55.276632] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 09:42:55.276656] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:42:55.277205] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 09:42:55.279734] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:42:55.280189] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 09:42:55.280229] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:42:55.280621] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 09:42:55.283551] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:42:55.284078] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 09:42:55.284103] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:42:55.284554] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 09:42:55.287423] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 09:42:55.287960] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 09:42:55.287984] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 09:42:55.288457] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 09:42:55.290910] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 09:42:55.294562] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 09:42:55.294853] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 09:42:55.294957] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:42:55.295192] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:42:55.295238] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 09:42:55.301895] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 09:42:55.302198] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 09:42:55.302226] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 09:55:04.817740] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 09:55:04.829721] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 09:55:04.829847] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 09:55:04.836385] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 09:55:04.840031] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 09:55:04.843415] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 09:55:04.846797] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 09:55:04.850175] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 09:55:04.853531] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 09:55:04.856934] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 09:55:04.860292] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 09:55:04.865059] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 09:55:04.865148] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 09:55:04.865189] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 09:55:04.865224] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 09:55:04.865318] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 09:55:04.865373] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 09:55:04.865417] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 09:55:04.865458] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 09:55:08.833294] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 09:55:08.837837] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 09:55:08.838126] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 09:55:08.838245] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:55:08.838454] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 09:55:08.838505] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 09:55:08.848727] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 09:55:08.849066] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 09:55:08.849165] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:03:26.740339] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:03:26.762323] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:03:26.762448] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:03:26.770238] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:03:26.773893] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:03:26.777336] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:03:26.780730] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:03:26.784165] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:03:26.787540] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:03:26.790922] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:03:26.794328] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:03:26.799413] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:03:26.799510] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:03:26.799592] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:03:26.799660] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:03:26.799775] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:03:26.799843] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:03:26.799901] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:03:26.800058] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:03:30.765901] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:03:30.766655] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:03:30.766722] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:03:30.767221] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:03:30.768993] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:03:30.769555] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:03:30.769600] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:03:30.770020] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:03:30.771845] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:03:30.780240] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:03:30.780419] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:03:30.780688] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:03:30.780836] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:03:30.780943] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:03:30.781470] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 10:03:30.781514] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:03:30.781957] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 10:03:30.785780] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:03:30.786412] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 10:03:30.786457] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:03:30.786959] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 10:03:33.781397] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:03:33.788383] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-7: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:04:46.931613] I [glusterfsd-mgmt.c:64:mgmt_cbk_spec] 0-mgmt: Volume file changed >[2012-12-07 10:04:47.007723] I [glusterfsd-mgmt.c:1565:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing >[2012-12-07 10:08:01.172525] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:08:01.172710] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:08:06.311835] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:08:06.312898] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:08:06.313064] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:08:34.797757] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:08:34.835399] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:08:34.835510] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:08:34.841448] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:08:34.845033] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:08:34.848414] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:08:34.855163] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:08:34.858544] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:08:34.861908] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:08:34.865380] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:08:34.869773] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:08:34.874655] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:08:34.874811] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:08:34.874911] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:08:34.875096] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:08:34.875232] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:08:34.875409] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:08:34.875485] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:08:34.875910] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:08:38.820225] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:08:38.821217] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:08:38.821324] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:08:38.822062] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:08:38.825583] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:08:38.826242] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:08:38.826287] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:08:38.826863] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:08:38.828775] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:08:38.829410] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 10:08:38.829455] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:08:38.830004] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 10:08:38.832051] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:08:38.832564] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 10:08:38.832606] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:08:38.833003] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 10:08:38.834770] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:08:38.839429] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:08:38.841892] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:08:38.842023] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:08:41.837304] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:08:47.843429] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:09:50.259612] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:09:50.272418] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:09:50.272532] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:09:50.278760] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:09:50.282317] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:09:50.285774] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:09:50.289181] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:09:50.292625] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:09:50.296092] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:09:50.299497] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:09:50.302917] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:09:50.307838] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:09:50.307923] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:09:50.308181] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:09:50.308374] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:09:50.308448] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:09:50.308507] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:09:50.308573] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:09:50.308641] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:09:54.275734] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:09:54.276423] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:09:54.276468] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:09:54.277042] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:09:54.279728] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:09:54.280313] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:09:54.280357] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:09:54.280876] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:09:54.283546] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:09:54.284031] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 10:09:54.284075] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:09:54.284565] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 10:09:54.287008] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:09:54.290843] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:09:54.291152] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:09:54.291271] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:09:54.291471] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:09:54.291539] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:09:54.295718] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:09:54.296444] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 10:09:54.296488] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:09:54.297091] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 10:09:54.298060] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:09:54.298424] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:09:54.298496] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:13:32.264643] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:13:32.298414] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:13:32.298614] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:13:32.306873] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:13:32.310477] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:13:32.313933] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:13:32.317369] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:13:32.320814] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:13:32.324254] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:13:32.327657] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:13:32.331126] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:13:32.336562] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:13:32.336732] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:13:32.336806] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:13:32.336873] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:13:32.336938] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:13:32.337043] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:13:32.337200] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:13:32.337323] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:13:36.308488] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:13:36.309033] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:13:36.309079] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:13:36.309509] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:13:36.319187] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:13:36.319798] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:13:36.319842] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:13:36.320322] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:13:36.323180] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:13:36.323718] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 10:13:36.323807] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:13:36.324266] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 10:13:36.327479] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:13:36.327995] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 10:13:36.328054] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:13:36.328509] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 10:13:57.297844] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:13:57.305002] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:13:57.305636] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:13:57.306081] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:13:57.306334] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:13:57.311731] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:13:57.314729] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-7: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:13:57.315006] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:13:57.315066] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:13:57.321491] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:13:57.323171] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:13:57.323268] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:14:09.126297] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:14:09.139248] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:14:09.139373] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:14:09.146073] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:09.149754] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:09.153170] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:09.156574] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:09.159978] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:09.163362] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:09.184164] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:09.189952] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:14:09.197120] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:14:09.197253] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:14:09.197334] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:14:09.197943] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:14:09.198297] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:14:09.198518] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:14:09.198628] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:14:09.198799] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:14:13.142532] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:14:13.147445] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:14:13.147827] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:14:13.147941] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:14:13.148110] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:14:13.148357] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:14:13.148417] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:14:13.148720] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:14:13.148744] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:14:13.149254] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:14:13.151912] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:14:13.152453] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:14:13.152497] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:14:13.152919] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:14:13.153072] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:14:13.153894] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:14:13.153980] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:14:29.480623] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:14:29.491163] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:14:29.491289] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:14:29.497331] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:29.500898] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:29.504387] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:29.507917] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:29.511325] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:29.514800] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:29.518216] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:29.521632] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:14:29.526852] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:14:29.527039] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:14:29.527111] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:14:29.527196] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:14:29.527289] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:14:29.527357] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:14:29.527474] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:14:29.527781] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:14:33.494143] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:14:33.498089] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:14:33.498386] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:14:33.498532] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:14:33.498745] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:14:33.498815] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:14:33.505025] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:14:33.505744] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:14:33.505829] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:14:35.033370] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:14:35.042332] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:14:35.042444] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:14:35.048469] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:35.051980] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:35.055330] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:35.058635] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:35.061965] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:35.065344] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:35.068671] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:14:35.071998] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:14:35.076972] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:14:35.077204] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:14:35.077327] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:14:35.077439] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:14:35.077549] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:14:35.077921] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:14:35.078100] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:14:35.078216] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:14:39.045959] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:14:39.046584] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:14:39.046629] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:14:39.047320] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:14:39.050101] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:14:39.050814] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:14:39.050859] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:14:39.051469] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:14:39.057475] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:14:39.058181] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 10:14:39.058226] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:14:39.058777] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 10:14:39.061301] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:14:39.061842] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 10:14:39.061886] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:14:39.062382] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 10:15:00.052862] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:15:00.058203] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:15:00.058677] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:15:00.058895] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:15:00.059190] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:15:00.059277] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:15:00.063758] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:15:00.065381] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:15:00.065840] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:15:00.066062] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:15:43.615472] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:15:43.627506] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:15:43.627623] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:15:43.633631] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:15:43.637189] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:15:43.640614] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:15:43.643986] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:15:43.647343] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:15:43.650733] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:15:43.654090] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:15:43.657461] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:15:43.662541] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:15:43.662622] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:15:43.662705] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:15:43.662798] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:15:43.663531] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:15:43.663632] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:15:43.663725] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:15:43.663789] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:15:47.630813] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:15:47.635790] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:15:47.636160] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:15:47.636279] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:15:47.636531] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:15:47.636599] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:15:47.636643] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:15:47.641196] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:15:47.642067] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:15:47.642347] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:15:47.642423] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:16:39.918661] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:16:39.930046] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:16:39.930163] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:16:39.936255] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:39.939835] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:39.943293] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:39.946739] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:39.950137] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:39.953547] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:39.957001] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:39.960434] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:16:39.965380] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:16:39.965524] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:16:39.965636] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:16:39.965764] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:16:39.965876] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:16:39.965949] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:16:39.966019] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:16:39.966159] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:16:43.934120] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:16:43.934742] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:16:43.934789] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:16:43.935224] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:16:43.937961] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:16:43.942470] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:16:43.943094] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:16:43.943364] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:16:43.943487] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:16:43.943571] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:16:43.943630] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:16:43.943920] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:16:43.943997] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:16:43.944126] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:16:43.946365] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:16:43.950780] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:16:43.951539] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:16:43.951605] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:16:49.902645] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:16:49.913816] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:16:49.914001] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:16:49.920175] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:49.923769] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:49.927247] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:49.930723] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:49.934201] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:49.937633] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:49.941104] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:16:49.944555] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:16:49.950060] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:16:49.950197] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:16:49.950289] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:16:49.950369] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:16:49.950480] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:16:49.950623] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:16:49.950927] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:16:49.951044] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:16:53.915735] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:16:53.916296] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:16:53.916342] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:16:53.916812] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:16:53.919733] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:16:53.920209] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:16:53.920252] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:16:53.920776] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:16:53.927088] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:16:53.927605] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 10:16:53.927649] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:16:53.928148] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 10:16:53.941305] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:16:53.941821] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 10:16:53.941867] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:16:53.942354] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 10:17:14.922853] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:17:14.927382] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:17:14.927745] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:17:14.927865] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:17:14.928132] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:17:14.928217] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:17:14.929761] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:17:14.933756] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-7: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:17:14.936732] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (Connection timed out) >[2012-12-07 10:17:14.938049] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:17:14.938531] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:17:14.938613] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:18:28.859187] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:18:28.914383] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:18:28.914490] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:18:28.920449] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:18:28.923988] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:18:28.927315] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:18:28.930633] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:18:28.933979] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:18:28.937331] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:18:28.940635] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:18:28.943956] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:18:28.949490] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:18:28.949770] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:18:28.949891] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:18:28.950006] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:18:28.950292] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:18:28.950416] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:18:28.950567] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:18:28.950671] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:18:32.885905] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:18:32.890605] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:18:32.895056] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:18:32.895212] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:18:32.895366] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:18:32.895824] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:18:32.895880] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:18:32.896386] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:18:32.896864] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:18:32.897422] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:18:32.897476] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:18:32.898018] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:18:32.899730] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:18:32.902993] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-6: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:18:32.906765] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:18:32.907341] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Connected to 10.70.35.13:49157, attached to remote volume '/opt/gluster/bricks/stripe/brick3'. >[2012-12-07 10:18:32.907395] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-2: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:18:32.907911] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-2: Server lk version = 1 >[2012-12-07 10:18:32.910263] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:18:32.910939] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Connected to 10.70.35.13:49158, attached to remote volume '/opt/gluster/bricks/stripe/brick4'. >[2012-12-07 10:18:32.910983] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-3: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:18:32.911631] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-3: Server lk version = 1 >[2012-12-07 10:18:35.912471] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-7: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:20:20.415633] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:20:20.428981] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:20:20.429098] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:20:20.435210] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:20:20.438784] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:20:20.442171] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:20:20.445591] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:20:20.449058] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:20:20.452430] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:20:20.455846] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:20:20.459216] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:20:20.464850] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:20:20.465014] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:20:20.465099] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:20:20.465162] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:20:20.465251] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:20:20.465324] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:20:20.465432] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:20:20.465496] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:20:24.432736] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:20:24.433449] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:20:24.433524] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:20:24.434135] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:20:24.437605] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:20:24.438228] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Connected to 10.70.35.13:49156, attached to remote volume '/opt/gluster/bricks/stripe/brick2'. >[2012-12-07 10:20:24.438272] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-1: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:20:24.438726] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-1: Server lk version = 1 >[2012-12-07 10:20:24.441317] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:20:24.445112] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:20:24.445669] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:20:24.445790] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:20:24.445979] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:20:24.446026] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:20:24.451787] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:20:24.452284] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:20:24.452374] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'. >[2012-12-07 10:34:35.542525] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0 >[2012-12-07 10:34:35.563900] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-quick-read: Max cache size is 2053902336 >[2012-12-07 10:34:35.564003] I [io-cache.c:1549:check_cache_size_ok] 0-automation-volume-stripe-io-cache: Max cache size is 2053902336 >[2012-12-07 10:34:35.572796] I [client.c:2142:notify] 0-automation-volume-stripe-client-0: parent translators are ready, attempting connect on transport >[2012-12-07 10:34:35.576744] I [client.c:2142:notify] 0-automation-volume-stripe-client-1: parent translators are ready, attempting connect on transport >[2012-12-07 10:34:35.580150] I [client.c:2142:notify] 0-automation-volume-stripe-client-2: parent translators are ready, attempting connect on transport >[2012-12-07 10:34:35.583502] I [client.c:2142:notify] 0-automation-volume-stripe-client-3: parent translators are ready, attempting connect on transport >[2012-12-07 10:34:35.586925] I [client.c:2142:notify] 0-automation-volume-stripe-client-4: parent translators are ready, attempting connect on transport >[2012-12-07 10:34:35.590292] I [client.c:2142:notify] 0-automation-volume-stripe-client-5: parent translators are ready, attempting connect on transport >[2012-12-07 10:34:35.593646] I [client.c:2142:notify] 0-automation-volume-stripe-client-6: parent translators are ready, attempting connect on transport >[2012-12-07 10:34:35.597051] I [client.c:2142:notify] 0-automation-volume-stripe-client-7: parent translators are ready, attempting connect on transport >Given volfile: >+------------------------------------------------------------------------------+ > 1: volume automation-volume-stripe-client-0 > 2: type protocol/client > 3: option transport-type tcp > 4: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 5: option remote-host 10.70.35.13 > 6: end-volume > 7: > 8: volume automation-volume-stripe-client-1 > 9: type protocol/client > 10: option transport-type tcp > 11: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 12: option remote-host 10.70.35.13 > 13: end-volume > 14: > 15: volume automation-volume-stripe-client-2 > 16: type protocol/client > 17: option transport-type tcp > 18: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 19: option remote-host 10.70.35.13 > 20: end-volume > 21: > 22: volume automation-volume-stripe-client-3 > 23: type protocol/client > 24: option transport-type tcp > 25: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 26: option remote-host 10.70.35.13 > 27: end-volume > 28: > 29: volume automation-volume-stripe-client-4 > 30: type protocol/client > 31: option transport-type tcp > 32: option remote-subvolume /opt/gluster/bricks/stripe/brick1 > 33: option remote-host 10.70.35.28 > 34: end-volume > 35: > 36: volume automation-volume-stripe-client-5 > 37: type protocol/client > 38: option transport-type tcp > 39: option remote-subvolume /opt/gluster/bricks/stripe/brick2 > 40: option remote-host 10.70.35.28 > 41: end-volume > 42: > 43: volume automation-volume-stripe-client-6 > 44: type protocol/client > 45: option transport-type tcp > 46: option remote-subvolume /opt/gluster/bricks/stripe/brick3 > 47: option remote-host 10.70.35.28 > 48: end-volume > 49: > 50: volume automation-volume-stripe-client-7 > 51: type protocol/client > 52: option transport-type tcp > 53: option remote-subvolume /opt/gluster/bricks/stripe/brick4 > 54: option remote-host 10.70.35.28 > 55: end-volume > 56: > 57: volume automation-volume-stripe-stripe-0 > 58: type cluster/stripe > 59: subvolumes automation-volume-stripe-client-0 automation-volume-stripe-client-1 automation-volume-stripe-client-2 automation-volume-stripe-client-3 automation-volume-stripe-client-4 automation-volume-stripe-client-5 automation-volume-stripe-client-6 automation-volume-stripe-client-7 > 60: end-volume > 61: > 62: volume automation-volume-stripe-dht > 63: type cluster/distribute > 64: subvolumes automation-volume-stripe-stripe-0 > 65: end-volume > 66: > 67: volume automation-volume-stripe-write-behind > 68: type performance/write-behind > 69: subvolumes automation-volume-stripe-dht > 70: end-volume > 71: > 72: volume automation-volume-stripe-read-ahead > 73: type performance/read-ahead > 74: subvolumes automation-volume-stripe-write-behind > 75: end-volume > 76: > 77: volume automation-volume-stripe-io-cache > 78: type performance/io-cache > 79: subvolumes automation-volume-stripe-read-ahead > 80: end-volume > 81: > 82: volume automation-volume-stripe-quick-read > 83: type performance/quick-read > 84: subvolumes automation-volume-stripe-io-cache > 85: end-volume > 86: > 87: volume automation-volume-stripe-md-cache > 88: type performance/md-cache > 89: subvolumes automation-volume-stripe-quick-read > 90: end-volume > 91: > 92: volume automation-volume-stripe > 93: type debug/io-stats > 94: option count-fop-hits off > 95: option latency-measurement off > 96: subvolumes automation-volume-stripe-md-cache > 97: end-volume > >+------------------------------------------------------------------------------+ >[2012-12-07 10:34:35.601892] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-4: changing port to 49159 (from 0) >[2012-12-07 10:34:35.601995] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-0: changing port to 49155 (from 0) >[2012-12-07 10:34:35.602056] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-5: changing port to 49160 (from 0) >[2012-12-07 10:34:35.602091] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-1: changing port to 49156 (from 0) >[2012-12-07 10:34:35.602149] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-6: changing port to 49161 (from 0) >[2012-12-07 10:34:35.602195] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-2: changing port to 49157 (from 0) >[2012-12-07 10:34:35.602238] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-7: changing port to 49162 (from 0) >[2012-12-07 10:34:35.602289] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 0-automation-volume-stripe-client-3: changing port to 49158 (from 0) >[2012-12-07 10:34:39.566191] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-4: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:34:39.570651] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: switched to graph 0 >[2012-12-07 10:34:39.571279] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 >[2012-12-07 10:34:39.571387] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:34:39.571562] E [dht-common.c:1372:dht_lookup] 0-automation-volume-stripe-dht: Failed to get hashed subvol for / >[2012-12-07 10:34:39.571615] W [fuse-bridge.c:513:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Invalid argument) >[2012-12-07 10:34:39.573004] I [client-handshake.c:1636:select_server_supported_programs] 0-automation-volume-stripe-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) >[2012-12-07 10:34:39.573578] I [client-handshake.c:1433:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Connected to 10.70.35.13:49155, attached to remote volume '/opt/gluster/bricks/stripe/brick1'. >[2012-12-07 10:34:39.573604] I [client-handshake.c:1445:client_setvolume_cbk] 0-automation-volume-stripe-client-0: Server and Client lk-version numbers are not same, reopening the fds >[2012-12-07 10:34:39.574082] I [client-handshake.c:453:client_set_lk_version_cbk] 0-automation-volume-stripe-client-0: Server lk version = 1 >[2012-12-07 10:34:39.576758] E [socket.c:1715:socket_connect_finish] 0-automation-volume-stripe-client-5: connection to 10.70.35.28:24007 failed (No route to host) >[2012-12-07 10:34:39.577771] I [fuse-bridge.c:4093:fuse_thread_proc] 0-fuse: unmounting /store/glusterMount/automation-volume-stripe >[2012-12-07 10:34:39.578100] W [glusterfsd.c:831:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x32cb0e811d] (-->/lib64/libpthread.so.0() [0x32cb807851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405cfd]))) 0-: received signum (15), shutting down >[2012-12-07 10:34:39.578128] I [fuse-bridge.c:4643:fini] 0-fuse: Unmounting '/store/glusterMount/automation-volume-stripe'.
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 885072
: 659336