Attachment 926219 Details for Bug 1129486 – glustershd.log from server gluster2

glustershd.log from server gluster2

gluster2-glustershd.log (text/plain), 13.89 KB, created by Scott Merrill on 2014-08-12 21:18:00 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Scott Merrill

Created: 2014-08-12 21:18:00 UTC

Size: 13.89 KB

patch

obsolete

>[2014-08-12 20:59:46.154983] I [glusterfsd.c:1959:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.5.2 (/usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/lib/glusterd/glustershd/run/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/2df1fa6567b898d24c7d5f4c98b073a2.socket --xlator-option *replicate*.node-uuid=23989211-4f0d-4087-b9c5-bc82295b2c38)
>[2014-08-12 20:59:46.160908] I [socket.c:3561:socket_init] 0-socket.glusterfsd: SSL support is NOT enabled
>[2014-08-12 20:59:46.160969] I [socket.c:3576:socket_init] 0-socket.glusterfsd: using system polling thread
>[2014-08-12 20:59:46.161160] I [socket.c:3561:socket_init] 0-glusterfs: SSL support is NOT enabled
>[2014-08-12 20:59:46.161178] I [socket.c:3576:socket_init] 0-glusterfs: using system polling thread
>[2014-08-12 20:59:46.175535] I [graph.c:254:gf_add_cmdline_options] 0-test-replicate-0: adding option 'node-uuid' for volume 'test-replicate-0' with value '23989211-4f0d-4087-b9c5-bc82295b2c38'
>[2014-08-12 20:59:46.179927] I [socket.c:3561:socket_init] 0-test-client-1: SSL support is NOT enabled
>[2014-08-12 20:59:46.179954] I [socket.c:3576:socket_init] 0-test-client-1: using system polling thread
>[2014-08-12 20:59:46.180430] I [socket.c:3561:socket_init] 0-test-client-0: SSL support is NOT enabled
>[2014-08-12 20:59:46.180452] I [socket.c:3576:socket_init] 0-test-client-0: using system polling thread
>[2014-08-12 20:59:46.180483] I [client.c:2294:notify] 0-test-client-0: parent translators are ready, attempting connect on transport
>[2014-08-12 20:59:46.186958] I [client.c:2294:notify] 0-test-client-1: parent translators are ready, attempting connect on transport
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume test-client-0
>  2:     type protocol/client
>  3:     option remote-host gluster1
>  4:     option remote-subvolume /bricks/brick1/brick
>  5:     option transport-type socket
>  6:     option username 0a75ffa8-0a6f-4722-b8a9-3fe5a9853fb4
>  7:     option password d4b3c8a7-b210-47c7-8d97-9db70ba8d5bc
>  8: end-volume
>  9: 
> 10: volume test-client-1
> 11:     type protocol/client
> 12:     option remote-host gluster2
> 13:     option remote-subvolume /bricks/brick1/brick
> 14:     option transport-type socket
> 15:     option username 0a75ffa8-0a6f-4722-b8a9-3fe5a9853fb4
> 16:     option password d4b3c8a7-b210-47c7-8d97-9db70ba8d5bc
> 17: end-volume
> 18: 
> 19: volume test-replicate-0
> 20:     type cluster/replicate
> 21:     option node-uuid 23989211-4f0d-4087-b9c5-bc82295b2c38
> 22:     option background-self-heal-count 0
> 23:     option metadata-self-heal on
> 24:     option data-self-heal on
> 25:     option entry-self-heal on
> 26:     option self-heal-daemon on
> 27:     option iam-self-heal-daemon yes
> 28:     subvolumes test-client-0 test-client-1
> 29: end-volume
> 30: 
> 31: volume glustershd
> 32:     type debug/io-stats
> 33:     subvolumes test-replicate-0
> 34: end-volume
> 35: 
>+------------------------------------------------------------------------------+
>[2014-08-12 20:59:46.193857] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-test-client-1: changing port to 49152 (from 0)
>[2014-08-12 20:59:46.200210] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-test-client-0: changing port to 49152 (from 0)
>[2014-08-12 20:59:46.206597] I [client-handshake.c:1677:select_server_supported_programs] 0-test-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2014-08-12 20:59:46.206935] I [client-handshake.c:1677:select_server_supported_programs] 0-test-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2014-08-12 20:59:46.207325] I [client-handshake.c:1462:client_setvolume_cbk] 0-test-client-0: Connected to 192.168.30.107:49152, attached to remote volume '/bricks/brick1/brick'.
>[2014-08-12 20:59:46.207348] I [client-handshake.c:1474:client_setvolume_cbk] 0-test-client-0: Server and Client lk-version numbers are not same, reopening the fds
>[2014-08-12 20:59:46.207428] I [afr-common.c:4131:afr_notify] 0-test-replicate-0: Subvolume 'test-client-0' came back up; going online.
>[2014-08-12 20:59:46.207575] I [client-handshake.c:450:client_set_lk_version_cbk] 0-test-client-0: Server lk version = 1
>[2014-08-12 20:59:46.211991] I [client-handshake.c:1462:client_setvolume_cbk] 0-test-client-1: Connected to 192.168.30.108:49152, attached to remote volume '/bricks/brick1/brick'.
>[2014-08-12 20:59:46.212032] I [client-handshake.c:1474:client_setvolume_cbk] 0-test-client-1: Server and Client lk-version numbers are not same, reopening the fds
>[2014-08-12 20:59:46.212187] I [client-handshake.c:450:client_set_lk_version_cbk] 0-test-client-1: Server lk version = 1
>[2014-08-12 20:59:46.212680] I [afr-self-heald.c:1690:afr_dir_exclusive_crawl] 0-test-replicate-0: Another crawl is in progress for test-client-1
>[2014-08-12 21:04:24.838281] I [glusterfsd-mgmt.c:56:mgmt_cbk_spec] 0-mgmt: Volume file changed
>[2014-08-12 21:04:24.843243] I [glusterfsd-mgmt.c:1307:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
>[2014-08-12 21:04:25.435166] W [glusterfsd.c:1095:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x7f144771d3dd] (-->/lib64/libpthread.so.0(+0x7df3) [0x7f1447dd4df3] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f14493a21b5]))) 0-: received signum (15), shutting down
>[2014-08-12 21:04:26.448734] I [glusterfsd.c:1959:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.5.2 (/usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/lib/glusterd/glustershd/run/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/2df1fa6567b898d24c7d5f4c98b073a2.socket --xlator-option *replicate*.node-uuid=23989211-4f0d-4087-b9c5-bc82295b2c38)
>[2014-08-12 21:04:26.454576] I [socket.c:3561:socket_init] 0-socket.glusterfsd: SSL support is NOT enabled
>[2014-08-12 21:04:26.454639] I [socket.c:3576:socket_init] 0-socket.glusterfsd: using system polling thread
>[2014-08-12 21:04:26.454826] I [socket.c:3561:socket_init] 0-glusterfs: SSL support is NOT enabled
>[2014-08-12 21:04:26.454843] I [socket.c:3576:socket_init] 0-glusterfs: using system polling thread
>[2014-08-12 21:04:26.469428] I [graph.c:254:gf_add_cmdline_options] 0-test-replicate-1: adding option 'node-uuid' for volume 'test-replicate-1' with value '23989211-4f0d-4087-b9c5-bc82295b2c38'
>[2014-08-12 21:04:26.469458] I [graph.c:254:gf_add_cmdline_options] 0-test-replicate-0: adding option 'node-uuid' for volume 'test-replicate-0' with value '23989211-4f0d-4087-b9c5-bc82295b2c38'
>[2014-08-12 21:04:26.477424] I [socket.c:3561:socket_init] 0-test-client-3: SSL support is NOT enabled
>[2014-08-12 21:04:26.477460] I [socket.c:3576:socket_init] 0-test-client-3: using system polling thread
>[2014-08-12 21:04:26.477922] I [socket.c:3561:socket_init] 0-test-client-2: SSL support is NOT enabled
>[2014-08-12 21:04:26.477939] I [socket.c:3576:socket_init] 0-test-client-2: using system polling thread
>[2014-08-12 21:04:26.478387] I [socket.c:3561:socket_init] 0-test-client-1: SSL support is NOT enabled
>[2014-08-12 21:04:26.478402] I [socket.c:3576:socket_init] 0-test-client-1: using system polling thread
>[2014-08-12 21:04:26.478875] I [socket.c:3561:socket_init] 0-test-client-0: SSL support is NOT enabled
>[2014-08-12 21:04:26.478891] I [socket.c:3576:socket_init] 0-test-client-0: using system polling thread
>[2014-08-12 21:04:26.478935] I [client.c:2294:notify] 0-test-client-0: parent translators are ready, attempting connect on transport
>[2014-08-12 21:04:26.485773] I [client.c:2294:notify] 0-test-client-1: parent translators are ready, attempting connect on transport
>[2014-08-12 21:04:26.492095] I [client.c:2294:notify] 0-test-client-2: parent translators are ready, attempting connect on transport
>[2014-08-12 21:04:26.498269] I [client.c:2294:notify] 0-test-client-3: parent translators are ready, attempting connect on transport
>Final graph:
>+------------------------------------------------------------------------------+
>  1: volume test-client-0
>  2:     type protocol/client
>  3:     option remote-host gluster1
>  4:     option remote-subvolume /bricks/brick1/brick
>  5:     option transport-type socket
>  6:     option username 0a75ffa8-0a6f-4722-b8a9-3fe5a9853fb4
>  7:     option password d4b3c8a7-b210-47c7-8d97-9db70ba8d5bc
>  8: end-volume
>  9: 
> 10: volume test-client-1
> 11:     type protocol/client
> 12:     option remote-host gluster2
> 13:     option remote-subvolume /bricks/brick1/brick
> 14:     option transport-type socket
> 15:     option username 0a75ffa8-0a6f-4722-b8a9-3fe5a9853fb4
> 16:     option password d4b3c8a7-b210-47c7-8d97-9db70ba8d5bc
> 17: end-volume
> 18: 
> 19: volume test-replicate-0
> 20:     type cluster/replicate
> 21:     option node-uuid 23989211-4f0d-4087-b9c5-bc82295b2c38
> 22:     option background-self-heal-count 0
> 23:     option metadata-self-heal on
> 24:     option data-self-heal on
> 25:     option entry-self-heal on
> 26:     option self-heal-daemon on
> 27:     option iam-self-heal-daemon yes
> 28:     subvolumes test-client-0 test-client-1
> 29: end-volume
> 30: 
> 31: volume test-client-2
> 32:     type protocol/client
> 33:     option remote-host gluster1
> 34:     option remote-subvolume /bricks/brick2/brick
> 35:     option transport-type socket
> 36:     option username 0a75ffa8-0a6f-4722-b8a9-3fe5a9853fb4
> 37:     option password d4b3c8a7-b210-47c7-8d97-9db70ba8d5bc
> 38: end-volume
> 39: 
> 40: volume test-client-3
> 41:     type protocol/client
> 42:     option remote-host gluster2
> 43:     option remote-subvolume /bricks/brick2/brick
> 44:     option transport-type socket
> 45:     option username 0a75ffa8-0a6f-4722-b8a9-3fe5a9853fb4
> 46:     option password d4b3c8a7-b210-47c7-8d97-9db70ba8d5bc
> 47: end-volume
> 48: 
> 49: volume test-replicate-1
> 50:     type cluster/replicate
> 51:     option node-uuid 23989211-4f0d-4087-b9c5-bc82295b2c38
> 52:     option background-self-heal-count 0
> 53:     option metadata-self-heal on
> 54:     option data-self-heal on
> 55:     option entry-self-heal on
> 56:     option self-heal-daemon on
> 57:     option iam-self-heal-daemon yes
> 58:     subvolumes test-client-2 test-client-3
> 59: end-volume
> 60: 
> 61: volume glustershd
> 62:     type debug/io-stats
> 63:     subvolumes test-replicate-0 test-replicate-1
> 64: end-volume
> 65: 
>+------------------------------------------------------------------------------+
>[2014-08-12 21:04:26.505288] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-test-client-1: changing port to 49152 (from 0)
>[2014-08-12 21:04:26.505348] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-test-client-0: changing port to 49152 (from 0)
>[2014-08-12 21:04:26.518020] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-test-client-3: changing port to 49153 (from 0)
>[2014-08-12 21:04:26.524466] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-test-client-2: changing port to 49153 (from 0)
>[2014-08-12 21:04:26.530909] I [client-handshake.c:1677:select_server_supported_programs] 0-test-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2014-08-12 21:04:26.531055] I [client-handshake.c:1677:select_server_supported_programs] 0-test-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2014-08-12 21:04:26.531152] I [client-handshake.c:1677:select_server_supported_programs] 0-test-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2014-08-12 21:04:26.531241] I [client-handshake.c:1677:select_server_supported_programs] 0-test-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2014-08-12 21:04:26.531339] I [client-handshake.c:1462:client_setvolume_cbk] 0-test-client-1: Connected to 192.168.30.108:49152, attached to remote volume '/bricks/brick1/brick'.
>[2014-08-12 21:04:26.531356] I [client-handshake.c:1474:client_setvolume_cbk] 0-test-client-1: Server and Client lk-version numbers are not same, reopening the fds
>[2014-08-12 21:04:26.531465] I [afr-common.c:4131:afr_notify] 0-test-replicate-0: Subvolume 'test-client-1' came back up; going online.
>[2014-08-12 21:04:26.531595] I [client-handshake.c:450:client_set_lk_version_cbk] 0-test-client-1: Server lk version = 1
>[2014-08-12 21:04:26.531658] I [client-handshake.c:1462:client_setvolume_cbk] 0-test-client-3: Connected to 192.168.30.108:49153, attached to remote volume '/bricks/brick2/brick'.
>[2014-08-12 21:04:26.531686] I [client-handshake.c:1474:client_setvolume_cbk] 0-test-client-3: Server and Client lk-version numbers are not same, reopening the fds
>[2014-08-12 21:04:26.531762] I [afr-common.c:4131:afr_notify] 0-test-replicate-1: Subvolume 'test-client-3' came back up; going online.
>[2014-08-12 21:04:26.531850] I [client-handshake.c:1462:client_setvolume_cbk] 0-test-client-0: Connected to 192.168.30.107:49152, attached to remote volume '/bricks/brick1/brick'.
>[2014-08-12 21:04:26.531866] I [client-handshake.c:1474:client_setvolume_cbk] 0-test-client-0: Server and Client lk-version numbers are not same, reopening the fds
>[2014-08-12 21:04:26.531980] I [client-handshake.c:1462:client_setvolume_cbk] 0-test-client-2: Connected to 192.168.30.107:49153, attached to remote volume '/bricks/brick2/brick'.
>[2014-08-12 21:04:26.531997] I [client-handshake.c:1474:client_setvolume_cbk] 0-test-client-2: Server and Client lk-version numbers are not same, reopening the fds
>[2014-08-12 21:04:26.532134] I [client-handshake.c:450:client_set_lk_version_cbk] 0-test-client-3: Server lk version = 1
>[2014-08-12 21:04:26.532174] I [client-handshake.c:450:client_set_lk_version_cbk] 0-test-client-0: Server lk version = 1
>[2014-08-12 21:04:26.532294] I [client-handshake.c:450:client_set_lk_version_cbk] 0-test-client-2: Server lk version = 1
>[2014-08-12 21:04:26.532827] I [afr-self-heald.c:1690:afr_dir_exclusive_crawl] 0-test-replicate-0: Another crawl is in progress for test-client-1
>[2014-08-12 21:04:26.533339] I [afr-self-heald.c:1690:afr_dir_exclusive_crawl] 0-test-replicate-1: Another crawl is in progress for test-client-3
>[2014-08-12 21:04:26.533582] I [afr-self-heald.c:1690:afr_dir_exclusive_crawl] 0-test-replicate-0: Another crawl is in progress for test-client-1
>[2014-08-12 21:04:26.533717] I [afr-self-heald.c:1690:afr_dir_exclusive_crawl] 0-test-replicate-1: Another crawl is in progress for test-client-3

Actions: View

Attachments on bug 1129486: 926217 | 926218 | 926219