Attachment 665243 Details for Bug 888072 – Client log file

Client log file

glusterscratch.log.1 (text/plain), 10.80 KB, created by Glenn on 2012-12-18 02:59:55 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Glenn

Created: 2012-12-18 02:59:55 UTC

Size: 10.80 KB

patch

obsolete

>[2012-12-09 04:02:03.692720] I [glusterfsd-mgmt.c:1565:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
>[2012-12-10 07:30:09.836119] I [glusterfsd-mgmt.c:64:mgmt_cbk_spec] 0-mgmt: Volume file changed
>[2012-12-10 07:30:11.355686] I [io-cache.c:1549:check_cache_size_ok] 0-krypton-io-cache: Max cache size is 25268006912
>[2012-12-10 07:30:11.355745] I [io-cache.c:1549:check_cache_size_ok] 0-krypton-quick-read: Max cache size is 25268006912
>[2012-12-15 07:13:32.177126] E [rpc-clnt.c:208:call_bail] 0-krypton-client-0: bailing out frame type(GlusterFS 3.1) op(FSYNC(16)) xid = 0x1587003x sent = 2012-12-15 06:43:26.779859. timeout = 1800
>[2012-12-15 07:13:32.198339] W [client3_1-fops.c:938:client3_1_fsync_cbk] 0-krypton-client-0: remote operation failed: Transport endpoint is not connected
>[2012-12-15 07:13:32.216705] W [fuse-bridge.c:968:fuse_err_cbk] 0-glusterfs-fuse: 158228118: FSYNC() ERR => -1 (Transport endpoint is not connected)
>[2012-12-15 07:40:33.859171] E [rpc-clnt.c:208:call_bail] 0-krypton-client-12: bailing out frame type(GlusterFS 3.1) op(FSYNC(16)) xid = 0x973772x sent = 2012-12-15 07:10:27.035015. timeout = 1800
>[2012-12-15 07:40:33.859205] W [client3_1-fops.c:938:client3_1_fsync_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected
>[2012-12-15 07:40:33.859227] W [fuse-bridge.c:968:fuse_err_cbk] 0-glusterfs-fuse: 159119317: FSYNC() ERR => -1 (Transport endpoint is not connected)
>[2012-12-15 07:44:14.294599] C [rpc-clnt.c:476:rpc_clnt_fill_request_info] 0-krypton-client-0: cannot lookup the saved frame corresponding to xid (1587003)
>[2012-12-15 07:44:14.294713] W [socket.c:1353:__socket_read_reply] 0-krypton-client-0: notify for event MAP_XID failed
>[2012-12-15 07:44:14.308548] I [client.c:2090:client_rpc_notify] 0-krypton-client-0: disconnected
>[2012-12-15 07:44:18.985088] W [client3_1-fops.c:763:client3_1_statfs_cbk] 0-krypton-client-0: remote operation failed: Transport endpoint is not connected
>[2012-12-15 07:44:25.161703] I [client-handshake.c:1636:select_server_supported_programs] 0-krypton-client-0: Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
>[2012-12-15 07:44:25.162143] I [client-handshake.c:1433:client_setvolume_cbk] 0-krypton-client-0: Connected to 172.29.15.247:24009, attached to remote volume '/mnt/gluster-0'.
>[2012-12-15 07:44:25.162160] I [client-handshake.c:1445:client_setvolume_cbk] 0-krypton-client-0: Server and Client lk-version numbers are not same, reopening the fds
>[2012-12-15 07:44:25.162354] I [client-handshake.c:453:client_set_lk_version_cbk] 0-krypton-client-0: Server lk version = 1
>[2012-12-15 08:00:21.594770] C [rpc-clnt.c:476:rpc_clnt_fill_request_info] 0-krypton-client-12: cannot lookup the saved frame corresponding to xid (973772)
>[2012-12-15 08:00:21.594841] W [socket.c:1353:__socket_read_reply] 0-krypton-client-12: notify for event MAP_XID failed
>[2012-12-15 08:00:21.662992] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0xe7) [0x334360f547] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb2) [0x334360ef42] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x334360ebfe]))) 0-krypton-client-12: forced unwinding frame type(GlusterFS 3.1) op(READ(12)) called at 2012-12-15 08:00:21.315759 (xid=0x981110x)
>[2012-12-15 08:00:21.663048] W [client3_1-fops.c:2700:client3_1_readv_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected
>[2012-12-15 08:00:21.663080] W [page.c:984:__ioc_page_error] 0-krypton-io-cache: page error for page = 0x2aaac80333f0 & waitq = 0x2aaac80334a0
>[2012-12-15 08:00:21.667990] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0xe7) [0x334360f547] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb2) [0x334360ef42] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x334360ebfe]))) 0-krypton-client-12: forced unwinding frame type(GlusterFS 3.1) op(READ(12)) called at 2012-12-15 08:00:21.315768 (xid=0x981111x)
>[2012-12-15 08:00:21.668004] W [client3_1-fops.c:2700:client3_1_readv_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected
>[2012-12-15 08:00:21.678683] W [page.c:984:__ioc_page_error] 0-krypton-io-cache: page error for page = 0x2aaac8033c80 & waitq = 0x2aaac80442c0
>[2012-12-15 08:00:21.678834] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0xe7) [0x334360f547] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb2) [0x334360ef42] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x334360ebfe]))) 0-krypton-client-12: forced unwinding frame type(GlusterFS 3.1) op(READ(12)) called at 2012-12-15 08:00:21.315779 (xid=0x981112x)
>[2012-12-15 08:00:21.678850] W [client3_1-fops.c:2700:client3_1_readv_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected
>[2012-12-15 08:00:21.678881] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0xe7) [0x334360f547] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb2) [0x334360ef42] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x334360ebfe]))) 0-krypton-client-12: forced unwinding frame type(GlusterFS 3.1) op(READ(12)) called at 2012-12-15 08:00:21.315785 (xid=0x981113x)
>[2012-12-15 08:00:21.678893] W [client3_1-fops.c:2700:client3_1_readv_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected
>[2012-12-15 08:00:21.678923] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0xe7) [0x334360f547] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb2) [0x334360ef42] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x334360ebfe]))) 0-krypton-client-12: forced unwinding frame type(GlusterFS 3.1) op(READ(12)) called at 2012-12-15 08:00:21.315791 (xid=0x981114x)
>[2012-12-15 08:00:21.678937] W [client3_1-fops.c:2700:client3_1_readv_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected
>[2012-12-15 08:00:21.678953] I [client.c:2090:client_rpc_notify] 0-krypton-client-12: disconnected
>[2012-12-15 08:00:21.718622] W [client3_1-fops.c:4059:client3_1_flush] 0-krypton-client-12:  (e205c602-36ee-4782-b4f9-6921d55225cb) remote_fd is -1. EBADFD
>[2012-12-15 08:00:21.721269] W [client3_1-fops.c:2630:client3_1_lookup_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected. Path: / (00000000-0000-0000-0000-000000000001)
>[2012-12-15 08:00:21.782760] I [dht-layout.c:593:dht_layout_normalize] 0-krypton-dht: found anomalies in /. holes=1 overlaps=0
>[2012-12-15 08:00:21.793615] W [dht-selfheal.c:875:dht_selfheal_directory] 0-krypton-dht: 1 subvolumes down -- not fixing
>[2012-12-15 08:00:21.811236] W [client3_1-fops.c:2630:client3_1_lookup_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected. Path: /Users (5f0e0a34-9c3a-41e3-9b0a-df363573032f)
>[2012-12-15 08:00:21.817929] I [dht-layout.c:593:dht_layout_normalize] 0-krypton-dht: found anomalies in /Users. holes=1 overlaps=0
>[2012-12-15 08:00:21.817980] W [dht-selfheal.c:875:dht_selfheal_directory] 0-krypton-dht: 1 subvolumes down -- not fixing
>[2012-12-15 08:00:21.818556] W [client3_1-fops.c:2630:client3_1_lookup_cbk] 0-krypton-client-12: remote operation failed: Transport endpoint is not connected. Path: /Users/xxxxxx (31c1536c-cdac-4e81-9e29-e6ef1e8db8b5)
>[2012-12-15 08:00:21.819115] I [dht-layout.c:593:dht_layout_normalize] 0-krypton-dht: found anomalies in /Users/xxxxxx. holes=1 overlaps=0
>[2012-12-15 08:00:21.819132] W [dht-selfheal.c:875:dht_selfheal_directory] 0-krypton-dht: 1 subvolumes down -- not fixing
>[2012-12-15 08:00:21.819204] W [dht-layout.c:186:dht_layout_search] 0-krypton-dht: no subvolume for hash (value) = 1533886244
>[2012-12-15 08:00:21.819221] E [dht-common.c:1372:dht_lookup] 0-krypton-dht: Failed to get hashed subvol for /Users/xxxxxx/xxxxxx3
>[2012-12-15 08:00:21.819255] W [dht-layout.c:186:dht_layout_search] 0-krypton-dht: no subvolume for hash (value) = 1533886244
>[2012-12-15 08:00:21.819266] E [dht-common.c:1372:dht_lookup] 0-krypton-dht: Failed to get hashed subvol for /Users/xxxxxx/xxxxxx3
>[2012-12-15 08:00:21.819291] W [fuse-bridge.c:292:fuse_entry_cbk] 0-glusterfs-fuse: 159732703: LOOKUP() /Users/xxxxxx/xxxxxx3 => -1 (Invalid argument)
>[2012-12-15 08:00:21.819411] W [dht-layout.c:186:dht_layout_search] 0-krypton-dht: no subvolume for hash (value) = 1533886244
>[2012-12-15 08:00:21.819425] E [dht-common.c:1372:dht_lookup] 0-krypton-dht: Failed to get hashed subvol for /Users/xxxxxx/xxxxxx3
>[2012-12-15 08:00:21.819437] W [fuse-bridge.c:292:fuse_entry_cbk] 0-glusterfs-fuse: 159732711: LOOKUP() /Users/xxxxxx/xxxxxx3 => -1 (Invalid argument)
>[2012-12-15 08:00:21.819513] W [dht-layout.c:186:dht_layout_search] 0-krypton-dht: no subvolume for hash (value) = 1533886244
>[2012-12-15 08:00:21.819527] E [dht-common.c:1372:dht_lookup] 0-krypton-dht: Failed to get hashed subvol for /Users/xxxxxx/xxxxxx3
>[2012-12-15 08:00:21.819538] W [fuse-bridge.c:292:fuse_entry_cbk] 0-glusterfs-fuse: 159732712: LOOKUP() /Users/xxxxxx/xxxxxx3 => -1 (Invalid argument)
>[2012-12-15 08:00:21.826452] W [dht-layout.c:186:dht_layout_search] 0-krypton-dht: no subvolume for hash (value) = 1533886244
>[2012-12-15 08:00:21.826488] E [dht-common.c:1372:dht_lookup] 0-krypton-dht: Failed to get hashed subvol for /Users/xxxxxx/xxxxxx3
>[2012-12-15 08:00:21.826506] W [fuse-bridge.c:292:fuse_entry_cbk] 0-glusterfs-fuse: 159732713: LOOKUP() /Users/xxxxxx/xxxxxx3 => -1 (Invalid argument)
>[2012-12-15 08:00:21.827607] W [dht-layout.c:186:dht_layout_search] 0-krypton-dht: no subvolume for hash (value) = 1533886244
>[2012-12-15 08:00:21.827622] E [dht-common.c:1372:dht_lookup] 0-krypton-dht: Failed to get hashed subvol for /Users/xxxxxx/xxxxxx3
>[2012-12-15 08:00:21.827634] W [fuse-bridge.c:292:fuse_entry_cbk] 0-glusterfs-fuse: 159732714: LOOKUP() /Users/xxxxxx/xxxxxx3 => -1 (Invalid argument)
>[2012-12-15 08:00:32.156625] I [client-handshake.c:1636:select_server_supported_programs] 0-krypton-client-12: Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
>[2012-12-15 08:00:32.156999] I [client-handshake.c:1433:client_setvolume_cbk] 0-krypton-client-12: Connected to 172.29.15.244:24009, attached to remote volume '/mnt/gluster-1'.
>[2012-12-15 08:00:32.157015] I [client-handshake.c:1445:client_setvolume_cbk] 0-krypton-client-12: Server and Client lk-version numbers are not same, reopening the fds
>[2012-12-15 08:00:32.157025] I [client-handshake.c:1282:client_post_handshake] 0-krypton-client-12: 1 fds open - Delaying child_up until they are re-opened
>[2012-12-15 08:00:32.225680] I [client-lk.c:601:decrement_reopen_fd_count] 0-krypton-client-12: last fd open'd/lock-self-heal'd - notifying CHILD-UP
>[2012-12-15 08:00:32.225916] I [client-handshake.c:453:client_set_lk_version_cbk] 0-krypton-client-12: Server lk version = 1
>[2012-12-16 04:04:02.285892] I [glusterfsd.c:889:reincarnate] 0-glusterfsd: Fetching the volume file from server...

Actions: View

Attachments on bug 888072: 665243