Attachment 579429 Details for Bug 815227 – glusterfs client log file

glusterfs client log file

mnt-glusterfs-.log (text/x-log), 15.30 KB, created by M S Vishwanath Bhat on 2012-04-23 07:37:34 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: M S Vishwanath Bhat

Created: 2012-04-23 07:37:34 UTC

Size: 15.30 KB

patch

obsolete

>[2012-04-23 03:09:19.019141] I [glusterfsd.c:1628:main] 0-/usr/local/sbin/glusterfs: Started running /usr/local/sbin/glusterfs version 3.3.0qa37
>[2012-04-23 03:09:19.036121] I [io-cache.c:1558:check_cache_size_ok] 0-hosdu-quick-read: Max cache size is 50595782656
>[2012-04-23 03:09:19.036197] I [io-cache.c:1558:check_cache_size_ok] 0-hosdu-io-cache: Max cache size is 50595782656
>[2012-04-23 03:09:19.038084] I [client.c:2151:notify] 0-hosdu-client-0: parent translators are ready, attempting connect on transport
>[2012-04-23 03:09:19.041005] I [client.c:2151:notify] 0-hosdu-client-1: parent translators are ready, attempting connect on transport
>Given volfile:
>+------------------------------------------------------------------------------+
>  1: volume hosdu-client-0
>  2:     type protocol/client
>  3:     option remote-host gqac015.sbu.lab.eng.bos.redhat.com
>  4:     option remote-subvolume /data/bricks/hosdu_brick1
>  5:     option transport-type tcp
>  6: end-volume
>  7: 
>  8: volume hosdu-client-1
>  9:     type protocol/client
> 10:     option remote-host gqac016.sbu.lab.eng.bos.redhat.com
> 11:     option remote-subvolume /data/bricks/hosdu_brick2
> 12:     option transport-type tcp
> 13: end-volume
> 14: 
> 15: volume hosdu-replicate-0
> 16:     type cluster/replicate
> 17:     subvolumes hosdu-client-0 hosdu-client-1
> 18: end-volume
> 19: 
> 20: volume hosdu-write-behind
> 21:     type performance/write-behind
> 22:     subvolumes hosdu-replicate-0
> 23: end-volume
> 24: 
> 25: volume hosdu-read-ahead
> 26:     type performance/read-ahead
> 27:     subvolumes hosdu-write-behind
> 28: end-volume
> 29: 
> 30: volume hosdu-io-cache
> 31:     type performance/io-cache
> 32:     subvolumes hosdu-read-ahead
> 33: end-volume
> 34: 
> 35: volume hosdu-quick-read
> 36:     type performance/quick-read
> 37:     subvolumes hosdu-io-cache
> 38: end-volume
> 39: 
> 40: volume hosdu-md-cache
> 41:     type performance/md-cache
> 42:     subvolumes hosdu-quick-read
> 43: end-volume
> 44: 
> 45: volume hosdu
> 46:     type debug/io-stats
> 47:     option latency-measurement off
> 48:     option count-fop-hits off
> 49:     subvolumes hosdu-md-cache
> 50: end-volume
>
>+------------------------------------------------------------------------------+
>[2012-04-23 03:09:19.044370] I [rpc-clnt.c:1669:rpc_clnt_reconfig] 0-hosdu-client-1: changing port to 24009 (from 0)
>[2012-04-23 03:09:19.044406] I [rpc-clnt.c:1669:rpc_clnt_reconfig] 0-hosdu-client-0: changing port to 24009 (from 0)
>[2012-04-23 03:09:23.037132] I [client-handshake.c:1632:select_server_supported_programs] 0-hosdu-client-1: Using Program GlusterFS 3.3.0qa37, Num (1298437), Version (330)
>[2012-04-23 03:09:23.037642] I [client-handshake.c:1429:client_setvolume_cbk] 0-hosdu-client-1: Connected to 10.16.157.45:24009, attached to remote volume '/data/bricks/hosdu_brick2'.
>[2012-04-23 03:09:23.037675] I [client-handshake.c:1441:client_setvolume_cbk] 0-hosdu-client-1: Server and Client lk-version numbers are not same, reopening the fds
>[2012-04-23 03:09:23.037749] I [afr-common.c:3629:afr_notify] 0-hosdu-replicate-0: Subvolume 'hosdu-client-1' came back up; going online.
>[2012-04-23 03:09:23.038001] I [client-handshake.c:456:client_set_lk_version_cbk] 0-hosdu-client-1: Server lk version = 1
>[2012-04-23 03:09:23.039939] I [client-handshake.c:1632:select_server_supported_programs] 0-hosdu-client-0: Using Program GlusterFS 3.3.0qa37, Num (1298437), Version (330)
>[2012-04-23 03:09:23.040410] I [client-handshake.c:1429:client_setvolume_cbk] 0-hosdu-client-0: Connected to 10.16.157.42:24009, attached to remote volume '/data/bricks/hosdu_brick1'.
>[2012-04-23 03:09:23.040440] I [client-handshake.c:1441:client_setvolume_cbk] 0-hosdu-client-0: Server and Client lk-version numbers are not same, reopening the fds
>[2012-04-23 03:09:23.044578] I [fuse-bridge.c:4122:fuse_graph_setup] 0-fuse: switched to graph 0
>[2012-04-23 03:09:23.044669] I [client-handshake.c:456:client_set_lk_version_cbk] 0-hosdu-client-0: Server lk version = 1
>[2012-04-23 03:09:23.044798] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13
>[2012-04-23 03:09:23.047047] I [afr-common.c:1971:afr_set_root_inode_on_first_lookup] 0-hosdu-replicate-0: added root inode
>[2012-04-23 03:10:03.319388] I [glusterfsd-mgmt.c:64:mgmt_cbk_spec] 0-mgmt: Volume file changed
>[2012-04-23 03:10:04.330842] I [glusterfsd-mgmt.c:64:mgmt_cbk_spec] 0-mgmt: Volume file changed
>[2012-04-23 03:10:04.332234] I [io-cache.c:1558:check_cache_size_ok] 0-hosdu-io-cache: Max cache size is 50595782656
>[2012-04-23 03:10:04.332283] I [io-cache.c:1558:check_cache_size_ok] 0-hosdu-quick-read: Max cache size is 50595782656
>[2012-04-23 03:10:04.332326] I [glusterfsd-mgmt.c:1584:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
>[2012-04-23 03:10:43.682861] I [glusterfsd-mgmt.c:64:mgmt_cbk_spec] 0-mgmt: Volume file changed
>[2012-04-23 03:10:46.099278] I [io-cache.c:1558:check_cache_size_ok] 1-hosdu-quick-read: Max cache size is 50595782656
>[2012-04-23 03:10:46.099338] I [io-cache.c:1558:check_cache_size_ok] 1-hosdu-io-cache: Max cache size is 50595782656
>[2012-04-23 03:10:46.103686] I [client.c:2151:notify] 1-hosdu-client-0: parent translators are ready, attempting connect on transport
>[2012-04-23 03:10:46.106938] I [client.c:2151:notify] 1-hosdu-client-1: parent translators are ready, attempting connect on transport
>[2012-04-23 03:10:46.109760] I [client.c:2151:notify] 1-hosdu-client-2: parent translators are ready, attempting connect on transport
>[2012-04-23 03:10:46.112506] I [client.c:2151:notify] 1-hosdu-client-3: parent translators are ready, attempting connect on transport
>Given volfile:
>+------------------------------------------------------------------------------+
>  1: volume hosdu-client-0
>  2:     type protocol/client
>  3:     option remote-host gqac015.sbu.lab.eng.bos.redhat.com
>  4:     option remote-subvolume /data/bricks/hosdu_brick1
>  5:     option transport-type tcp
>  6: end-volume
>  7: 
>  8: volume hosdu-client-1
>  9:     type protocol/client
> 10:     option remote-host gqac016.sbu.lab.eng.bos.redhat.com
> 11:     option remote-subvolume /data/bricks/hosdu_brick2
> 12:     option transport-type tcp
> 13: end-volume
> 14: 
> 15: volume hosdu-client-2
> 16:     type protocol/client
> 17:     option remote-host gqac014.sbu.lab.eng.bos.redhat.com
> 18:     option remote-subvolume /data/bricks/hosdu_brick3
> 19:     option transport-type tcp
> 20: end-volume
> 21: 
> 22: volume hosdu-client-3
> 23:     type protocol/client
> 24:     option remote-host gqac017.sbu.lab.eng.bos.redhat.com
> 25:     option remote-subvolume /data/bricks/hosdu_brick4
> 26:     option transport-type tcp
> 27: end-volume
> 28: 
> 29: volume hosdu-replicate-0
> 30:     type cluster/replicate
> 31:     subvolumes hosdu-client-0 hosdu-client-1
> 32: end-volume
> 33: 
> 34: volume hosdu-replicate-1
> 35:     type cluster/replicate
> 36:     subvolumes hosdu-client-2 hosdu-client-3
> 37: end-volume
> 38: 
> 39: volume hosdu-dht
> 40:     type cluster/distribute
> 41:     subvolumes hosdu-replicate-0 hosdu-replicate-1
> 42: end-volume
> 43: 
> 44: volume hosdu-write-behind
> 45:     type performance/write-behind
> 46:     subvolumes hosdu-dht
> 47: end-volume
> 48: 
> 49: volume hosdu-read-ahead
> 50:     type performance/read-ahead
> 51:     subvolumes hosdu-write-behind
> 52: end-volume
> 53: 
> 54: volume hosdu-io-cache
> 55:     type performance/io-cache
> 56:     subvolumes hosdu-read-ahead
> 57: end-volume
> 58: 
> 59: volume hosdu-quick-read
> 60:     type performance/quick-read
> 61:     subvolumes hosdu-io-cache
> 62: end-volume
> 63: 
> 64: volume hosdu-md-cache
> 65:     type performance/md-cache
> 66:     subvolumes hosdu-quick-read
> 67: end-volume
> 68: 
> 69: volume hosdu
> 70:     type debug/io-stats
> 71:     option latency-measurement on
> 72:     option count-fop-hits on
> 73:     subvolumes hosdu-md-cache
> 74: end-volume
>
>+------------------------------------------------------------------------------+
>[2012-04-23 03:10:46.115690] I [rpc-clnt.c:1669:rpc_clnt_reconfig] 1-hosdu-client-2: changing port to 24009 (from 0)
>[2012-04-23 03:10:48.127026] I [rpc-clnt.c:1669:rpc_clnt_reconfig] 1-hosdu-client-1: changing port to 24009 (from 0)
>[2012-04-23 03:10:48.128403] I [rpc-clnt.c:1669:rpc_clnt_reconfig] 1-hosdu-client-0: changing port to 24009 (from 0)
>[2012-04-23 03:10:48.531248] E [client-handshake.c:1713:client_query_portmap_cbk] 1-hosdu-client-3: failed to get the port number for remote subvolume
>[2012-04-23 03:10:48.531316] I [client.c:2099:client_rpc_notify] 1-hosdu-client-3: disconnected
>[2012-04-23 03:10:50.058023] I [client-handshake.c:1632:select_server_supported_programs] 1-hosdu-client-2: Using Program GlusterFS 3.3.0qa37, Num (1298437), Version (330)
>[2012-04-23 03:10:50.061128] I [client-handshake.c:1429:client_setvolume_cbk] 1-hosdu-client-2: Connected to 10.16.157.39:24009, attached to remote volume '/data/bricks/hosdu_brick3'.
>[2012-04-23 03:10:50.061158] I [client-handshake.c:1441:client_setvolume_cbk] 1-hosdu-client-2: Server and Client lk-version numbers are not same, reopening the fds
>[2012-04-23 03:10:50.061221] I [afr-common.c:3629:afr_notify] 1-hosdu-replicate-1: Subvolume 'hosdu-client-2' came back up; going online.
>[2012-04-23 03:10:50.061448] I [client-handshake.c:456:client_set_lk_version_cbk] 1-hosdu-client-2: Server lk version = 1
>[2012-04-23 03:10:52.060908] I [client-handshake.c:1632:select_server_supported_programs] 1-hosdu-client-1: Using Program GlusterFS 3.3.0qa37, Num (1298437), Version (330)
>[2012-04-23 03:10:52.061206] I [client-handshake.c:1429:client_setvolume_cbk] 1-hosdu-client-1: Connected to 10.16.157.45:24009, attached to remote volume '/data/bricks/hosdu_brick2'.
>[2012-04-23 03:10:52.061228] I [client-handshake.c:1441:client_setvolume_cbk] 1-hosdu-client-1: Server and Client lk-version numbers are not same, reopening the fds
>[2012-04-23 03:10:52.061275] I [afr-common.c:3629:afr_notify] 1-hosdu-replicate-0: Subvolume 'hosdu-client-1' came back up; going online.
>[2012-04-23 03:10:52.061394] I [client-handshake.c:456:client_set_lk_version_cbk] 1-hosdu-client-1: Server lk version = 1
>[2012-04-23 03:10:52.063928] I [client-handshake.c:1632:select_server_supported_programs] 1-hosdu-client-0: Using Program GlusterFS 3.3.0qa37, Num (1298437), Version (330)
>[2012-04-23 03:10:52.064311] I [client-handshake.c:1429:client_setvolume_cbk] 1-hosdu-client-0: Connected to 10.16.157.42:24009, attached to remote volume '/data/bricks/hosdu_brick1'.
>[2012-04-23 03:10:52.064331] I [client-handshake.c:1441:client_setvolume_cbk] 1-hosdu-client-0: Server and Client lk-version numbers are not same, reopening the fds
>[2012-04-23 03:10:52.068536] I [fuse-bridge.c:4122:fuse_graph_setup] 0-fuse: switched to graph 1
>[2012-04-23 03:10:52.068593] I [client-handshake.c:456:client_set_lk_version_cbk] 1-hosdu-client-0: Server lk version = 1
>[2012-04-23 03:10:52.069084] I [rpc-clnt.c:1669:rpc_clnt_reconfig] 1-hosdu-client-3: changing port to 24009 (from 0)
>[2012-04-23 03:10:52.115918] I [afr-common.c:1971:afr_set_root_inode_on_first_lookup] 1-hosdu-replicate-1: added root inode
>[2012-04-23 03:10:52.116653] I [afr-common.c:1971:afr_set_root_inode_on_first_lookup] 1-hosdu-replicate-0: added root inode
>[2012-04-23 03:10:52.149787] W [fuse-bridge.c:3597:fuse_migrate_fd] 0-glusterfs-fuse: name-less lookup of gfid (3cddb4a5-eb55-4311-b183-482770750ac3) failed (Invalid argument)
>[2012-04-23 03:10:52.159315] W [fuse-bridge.c:3597:fuse_migrate_fd] 0-glusterfs-fuse: name-less lookup of gfid (d1ebf0d1-6832-482e-89fb-f4dde38ed3ea) failed (Invalid argument)
>[2012-04-23 03:10:52.167464] W [fuse-bridge.c:3597:fuse_migrate_fd] 0-glusterfs-fuse: name-less lookup of gfid (adc70bcf-ba6a-44c1-9771-611cc56bf8e7) failed (Invalid argument)
>[2012-04-23 03:10:52.175840] W [fuse-bridge.c:3597:fuse_migrate_fd] 0-glusterfs-fuse: name-less lookup of gfid (8901f19a-599c-474e-a34c-2436b05a3b19) failed (Invalid argument)
>[2012-04-23 03:10:52.184197] W [fuse-bridge.c:3597:fuse_migrate_fd] 0-glusterfs-fuse: name-less lookup of gfid (9e4cd3a7-a5df-496d-b06a-84bd2226a917) failed (Invalid argument)
>[2012-04-23 03:10:52.184546] I [client.c:2160:notify] 0-hosdu-client-0: current graph is no longer active, destroying rpc_client 
>[2012-04-23 03:10:52.184595] I [client.c:2160:notify] 0-hosdu-client-1: current graph is no longer active, destroying rpc_client 
>[2012-04-23 03:10:52.184651] I [client.c:2099:client_rpc_notify] 0-hosdu-client-0: disconnected
>[2012-04-23 03:10:52.184690] I [client.c:2099:client_rpc_notify] 0-hosdu-client-1: disconnected
>[2012-04-23 03:10:52.184707] E [afr-common.c:3666:afr_notify] 0-hosdu-replicate-0: All subvolumes are down. Going offline until atleast one of them comes back up.
>[2012-04-23 03:10:52.185987] W [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse: 8901f19a-599c-474e-a34c-2436b05a3b19: failed to resolve (Invalid argument)
>[2012-04-23 03:10:52.186019] E [fuse-bridge.c:542:fuse_getattr_resume] 0-glusterfs-fuse: 12122: GETATTR 140539891329996 (8901f19a-599c-474e-a34c-2436b05a3b19) resolution failed
>[2012-04-23 03:10:52.187353] W [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse: 8901f19a-599c-474e-a34c-2436b05a3b19: failed to resolve (Invalid argument)
>[2012-04-23 03:10:52.187385] E [fuse-bridge.c:542:fuse_getattr_resume] 0-glusterfs-fuse: 12123: GETATTR 140539891329996 (8901f19a-599c-474e-a34c-2436b05a3b19) resolution failed
>[2012-04-23 03:10:52.198011] W [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse: adc70bcf-ba6a-44c1-9771-611cc56bf8e7: failed to resolve (Invalid argument)
>[2012-04-23 03:10:52.198086] E [fuse-bridge.c:1391:fuse_rmdir_resume] 0-glusterfs-fuse: RMDIR 140539891329848 (00000000-0000-0000-0000-000000000000/a) resolution failed
>[2012-04-23 03:10:52.199407] W [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse: d1ebf0d1-6832-482e-89fb-f4dde38ed3ea: failed to resolve (Invalid argument)
>[2012-04-23 03:10:52.199435] E [fuse-bridge.c:1391:fuse_rmdir_resume] 0-glusterfs-fuse: RMDIR 140539891329700 (00000000-0000-0000-0000-000000000000/a) resolution failed
>[2012-04-23 03:10:52.200744] W [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse: 3cddb4a5-eb55-4311-b183-482770750ac3: failed to resolve (Invalid argument)
>[2012-04-23 03:10:52.200768] E [fuse-bridge.c:1391:fuse_rmdir_resume] 0-glusterfs-fuse: RMDIR 140539891329552 (00000000-0000-0000-0000-000000000000/a) resolution failed
>[2012-04-23 03:10:52.202091] W [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse: 9e4cd3a7-a5df-496d-b06a-84bd2226a917: failed to resolve (Invalid argument)
>[2012-04-23 03:10:52.202124] E [fuse-bridge.c:1391:fuse_rmdir_resume] 0-glusterfs-fuse: RMDIR 140539891329404 (00000000-0000-0000-0000-000000000000/a) resolution failed
>[2012-04-23 03:10:52.203405] W [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse: cd89f397-9f09-483e-b572-c213d6830870: failed to resolve (Invalid argument)
>[2012-04-23 03:10:52.203436] W [fuse-bridge.c:2236:fuse_opendir_resume] 0-glusterfs-fuse: 13783: OPENDIR (cd89f397-9f09-483e-b572-c213d6830870) resolution failed
>[2012-04-23 03:10:56.071417] I [client-handshake.c:1632:select_server_supported_programs] 1-hosdu-client-3: Using Program GlusterFS 3.3.0qa37, Num (1298437), Version (330)
>[2012-04-23 03:10:56.071918] I [client-handshake.c:1429:client_setvolume_cbk] 1-hosdu-client-3: Connected to 10.16.157.48:24009, attached to remote volume '/data/bricks/hosdu_brick4'.
>[2012-04-23 03:10:56.071954] I [client-handshake.c:1441:client_setvolume_cbk] 1-hosdu-client-3: Server and Client lk-version numbers are not same, reopening the fds
>[2012-04-23 03:10:56.072290] I [client-handshake.c:456:client_set_lk_version_cbk] 1-hosdu-client-3: Server lk version = 1

Actions: View

Attachments on bug 815227: 579429