Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 1472715 Details for
Bug 1611635
infra: softserve machines, regression tests fails
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
Client logs with TRACE enabled
mnt.log (text/plain), 109.45 KB, created by
Kotresh HR
on 2018-08-02 14:11:05 UTC
(
hide
)
Description:
Client logs with TRACE enabled
Filename:
MIME Type:
Creator:
Kotresh HR
Created:
2018-08-02 14:11:05 UTC
Size:
109.45 KB
patch
obsolete
>[2018-07-31 10:41:38.273603] I [MSGID: 100030] [glusterfsd.c:2728:main] 0-/usr/local/sbin/glusterfs: Started running /usr/local/sbin/glusterfs version 4.2dev (args: /usr/local/sbin/glusterfs --process-name fuse --volfile-server=localhost --volfile-id=master /mnt) >[2018-07-31 10:41:38.274076] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/mount/fuse.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.274653] I [dict.c:2471:dict_get_str] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mount/fuse.so(init+0x5c0) [0x7f36fad6eb00] -->/usr/local/lib/libglusterfs.so.0(xlator_option_init_double+0xf2) [0x7f37039f6a74] -->/usr/local/lib/libglusterfs.so.0(dict_get_str+0x177) [0x7f370397efc0] ) 0-dict: key negative-timeout, string type asked, has float type [Invalid argument] >[2018-07-31 10:41:38.274768] I [dict.c:2471:dict_get_str] (-->/usr/local/lib/libglusterfs.so.0(+0x265f4) [0x7f37039845f4] -->/usr/local/lib/glusterfs/4.2dev/xlator/mount/fuse.so(init+0xa0d) [0x7f36fad6ef4d] -->/usr/local/lib/libglusterfs.so.0(dict_get_str+0x177) [0x7f370397efc0] ) 0-dict: key sync-to-mount, string type asked, has pointer type [Invalid argument] >[2018-07-31 10:41:38.274892] I [dict.c:2471:dict_get_str] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mount/fuse.so(init+0xd10) [0x7f36fad6f250] -->/usr/local/lib/libglusterfs.so.0(xlator_option_init_bool+0xf2) [0x7f37039f610f] -->/usr/local/lib/libglusterfs.so.0(dict_get_str+0x177) [0x7f370397efc0] ) 0-dict: key no-root-squash, string type asked, has pointer type [Invalid argument] >[2018-07-31 10:41:38.280129] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-glusterfs: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction >[2018-07-31 10:41:38.282142] I [dict.c:1180:data_to_uint16] (-->/usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(socket_client_get_remote_sockaddr+0x1dc) [0x7f36f811a388] -->/usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0x1287b) [0x7f36f811987b] -->/usr/local/lib/libglusterfs.so.0(data_to_uint16+0x11c) [0x7f370397b8dc] ) 0-dict: key null, unsigned integer type asked, has integer type [Invalid argument] >[2018-07-31 10:41:38.286074] I [MSGID: 101190] [event-epoll.c:617:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 >[2018-07-31 10:41:38.287410] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols >The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 3 times between [2018-07-31 10:41:38.287410] and [2018-07-31 10:41:38.287638] >[2018-07-31 10:41:38.287909] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/replicate.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.288005] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/replicate.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.288237] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/distribute.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.288412] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/write-behind.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.288558] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/read-ahead.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.288708] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/readdir-ahead.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.288901] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-cache.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.289177] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/open-behind.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.289497] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.289724] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/meta.so: undefined symbol: xlator_api. Fall back to old symbols >[2018-07-31 10:41:38.290547] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master: option logger not set >[2018-07-31 10:41:38.290576] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master: option log-format not set >[2018-07-31 10:41:38.290599] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master: option log-buf-size using default value 5 >[2018-07-31 10:41:38.290623] T [MSGID: 0] [options.c:1266:xlator_option_init_time] 0-master: option log-flush-timeout using default value 120 >[2018-07-31 10:41:38.290679] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-md-cache: option md-cache-timeout using default value 1 >[2018-07-31 10:41:38.290701] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option cache-selinux using default value false >[2018-07-31 10:41:38.290721] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option cache-capability-xattrs using default value true >[2018-07-31 10:41:38.290741] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option cache-ima-xattrs using default value true >[2018-07-31 10:41:38.290761] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option cache-posix-acl using default value false >[2018-07-31 10:41:38.290780] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option cache-swift-metadata using default value true >[2018-07-31 10:41:38.290806] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option cache-samba-metadata using default value false >[2018-07-31 10:41:38.290827] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option force-readdirp using default value true >[2018-07-31 10:41:38.290863] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option cache-invalidation using default value false >[2018-07-31 10:41:38.290886] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option pass-through using default value false >[2018-07-31 10:41:38.290906] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-md-cache: option md-cache-statfs using default value off >[2018-07-31 10:41:38.290926] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-md-cache: option xattr-cache-list using default value >[2018-07-31 10:41:38.290975] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-open-behind: option use-anonymous-fd using default value yes >[2018-07-31 10:41:38.290996] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-open-behind: option lazy-open using default value yes >[2018-07-31 10:41:38.291015] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-open-behind: option read-after-open using default value no >[2018-07-31 10:41:38.291034] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-open-behind: option pass-through using default value false >[2018-07-31 10:41:38.291080] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-quick-read: option max-file-size using default value 64KB >[2018-07-31 10:41:38.291110] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-quick-read: option cache-timeout using default value 1 >[2018-07-31 10:41:38.291128] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-quick-read: no range check required for 'option cache-timeout 1' >[2018-07-31 10:41:38.291147] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-quick-read: option cache-invalidation using default value false >[2018-07-31 10:41:38.291166] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-quick-read: option cache-size using default value 128MB >[2018-07-31 10:41:38.291265] D [MSGID: 0] [quick-read.c:966:check_cache_size_ok] 0-master-quick-read: Max cache size is 1922871296 >[2018-07-31 10:41:38.291293] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-quick-read: option ctime-invalidation using default value false >[2018-07-31 10:41:38.291342] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-io-cache: option pass-through using default value false >[2018-07-31 10:41:38.291366] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-io-cache: option cache-size using default value 32MB >[2018-07-31 10:41:38.291391] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-io-cache: option cache-timeout using default value 1 >[2018-07-31 10:41:38.291411] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-io-cache: option min-file-size using default value 0 >[2018-07-31 10:41:38.291428] T [MSGID: 0] [options.c:150:xlator_option_validate_sizet] 0-master-io-cache: no range check required for 'option min-file-size 0' >[2018-07-31 10:41:38.291447] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-io-cache: option max-file-size using default value 0 >[2018-07-31 10:41:38.291463] T [MSGID: 0] [options.c:150:xlator_option_validate_sizet] 0-master-io-cache: no range check required for 'option max-file-size 0' >[2018-07-31 10:41:38.291531] D [MSGID: 0] [io-cache.c:1638:check_cache_size_ok] 0-master-io-cache: Max cache size is 1922871296 >[2018-07-31 10:41:38.291576] D [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-readdir-ahead: option rda-request-size using set value 131072 >[2018-07-31 10:41:38.291607] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-readdir-ahead: option rda-low-wmark using default value 4096 >[2018-07-31 10:41:38.291628] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-readdir-ahead: option rda-high-wmark using default value 128KB >[2018-07-31 10:41:38.291648] D [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-readdir-ahead: option rda-cache-limit using set value 10MB >[2018-07-31 10:41:38.291668] D [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-readdir-ahead: option parallel-readdir using set value off >[2018-07-31 10:41:38.291687] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-readdir-ahead: option pass-through using default value false >[2018-07-31 10:41:38.291732] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-read-ahead: option page-size using default value 131072 >[2018-07-31 10:41:38.291759] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-read-ahead: option page-count using default value 4 >[2018-07-31 10:41:38.291779] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-read-ahead: option force-atime-update using default value false >[2018-07-31 10:41:38.291798] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-read-ahead: option pass-through using default value false >[2018-07-31 10:41:38.291859] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-write-behind: option aggregate-size using default value 128KB >[2018-07-31 10:41:38.291882] T [MSGID: 0] [options.c:150:xlator_option_validate_sizet] 0-master-write-behind: no range check required for 'option aggregate-size 128KB' >[2018-07-31 10:41:38.291915] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-write-behind: option cache-size using default value 1MB >[2018-07-31 10:41:38.291936] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-write-behind: option flush-behind using default value on >[2018-07-31 10:41:38.291955] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-write-behind: option trickling-writes using default value on >[2018-07-31 10:41:38.291973] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-write-behind: option strict-O_DIRECT using default value off >[2018-07-31 10:41:38.291992] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-write-behind: option strict-write-ordering using default value off >[2018-07-31 10:41:38.292012] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-write-behind: option resync-failed-syncs-after-fsync using default value off >[2018-07-31 10:41:38.292069] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option lookup-optimize using default value on >[2018-07-31 10:41:38.292090] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option unhashed-sticky-bit using default value off >[2018-07-31 10:41:38.292110] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option use-readdirp using default value on >[2018-07-31 10:41:38.292129] T [MSGID: 0] [options.c:1261:xlator_option_init_percent_or_size] 0-master-dht: option min-free-disk using default value 10% >[2018-07-31 10:41:38.292158] T [MSGID: 0] [options.c:1260:xlator_option_init_percent] 0-master-dht: option min-free-inodes using default value 5% >[2018-07-31 10:41:38.292180] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-dht: option directory-layout-spread not set >[2018-07-31 10:41:38.292199] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option assert-no-child-down using default value off >[2018-07-31 10:41:38.292220] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option readdir-optimize using default value off >[2018-07-31 10:41:38.292246] D [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option lock-migration using set value off >[2018-07-31 10:41:38.292271] D [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option force-migration using set value off >[2018-07-31 10:41:38.292364] D [MSGID: 0] [dht-shared.c:381:dht_init_regex] 0-master-dht: using regex rsync-hash-regex = ^\.(.+)\.[^.]+$ >[2018-07-31 10:41:38.292401] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option randomize-hash-range-by-gfid using default value off >[2018-07-31 10:41:38.292424] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-dht: option xattr-name using default value trusted.glusterfs.dht >[2018-07-31 10:41:38.292449] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-dht: option weighted-rebalance using default value on >[2018-07-31 10:41:38.292517] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option arbiter-count not set >[2018-07-31 10:41:38.292545] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-1: option thin-arbiter not set >[2018-07-31 10:41:38.292572] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-1: option afr-dirty-xattr using default value trusted.afr.dirty >[2018-07-31 10:41:38.292599] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option metadata-splitbrain-forced-heal using default value off >[2018-07-31 10:41:38.292617] T [MSGID: 0] [options.c:1263:xlator_option_init_xlator] 0-master-replicate-1: option read-subvolume not set >[2018-07-31 10:41:38.292635] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-replicate-1: option read-subvolume-index using default value -1 >[2018-07-31 10:41:38.292652] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-replicate-1: no range check required for 'option read-subvolume-index -1' >[2018-07-31 10:41:38.292670] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option choose-local using default value true >[2018-07-31 10:41:38.292696] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option read-hash-mode using default value 1 >[2018-07-31 10:41:38.292725] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-1: option favorite-child-policy using default value none >[2018-07-31 10:41:38.292751] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option shd-max-threads using default value 1 >[2018-07-31 10:41:38.292777] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option shd-wait-qlength using default value 1024 >[2018-07-31 10:41:38.292796] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option background-self-heal-count using default value 8 >[2018-07-31 10:41:38.292817] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option heal-wait-queue-length using default value 128 >[2018-07-31 10:41:38.292837] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-1: option data-self-heal using default value on >[2018-07-31 10:41:38.292878] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-1: option data-self-heal-algorithm not set >[2018-07-31 10:41:38.292899] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option data-self-heal-window-size using default value 1 >[2018-07-31 10:41:38.292920] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option metadata-self-heal using default value on >[2018-07-31 10:41:38.292941] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option entry-self-heal using default value on >[2018-07-31 10:41:38.292960] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option halo-shd-max-latency using default value 99999 >[2018-07-31 10:41:38.292979] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option halo-max-latency using default value 5 >[2018-07-31 10:41:38.292999] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option halo-max-replicas using default value 99999 >[2018-07-31 10:41:38.293019] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option halo-min-replicas using default value 2 >[2018-07-31 10:41:38.293039] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option halo-enabled using default value False >[2018-07-31 10:41:38.293058] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option halo-nfsd-max-latency using default value 5 >[2018-07-31 10:41:38.293082] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option iam-nfs-daemon using default value off >[2018-07-31 10:41:38.293104] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option optimistic-change-log using default value on >[2018-07-31 10:41:38.293126] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option pre-op-compat using default value on >[2018-07-31 10:41:38.293151] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-1: option locking-scheme using default value full >[2018-07-31 10:41:38.293177] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option full-lock using default value yes >[2018-07-31 10:41:38.293203] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option granular-entry-heal using default value no >[2018-07-31 10:41:38.293226] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option eager-lock using default value on >[2018-07-31 10:41:38.293248] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-1: option quorum-type using default value none >[2018-07-31 10:41:38.293271] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option quorum-count not set >[2018-07-31 10:41:38.293295] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-replicate-1: option self-heal-readdir-size using default value 1KB >[2018-07-31 10:41:38.293327] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-1: option post-op-delay-secs using default value 1 >[2018-07-31 10:41:38.293352] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option ensure-durability using default value on >[2018-07-31 10:41:38.293375] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option self-heal-daemon using default value on >[2018-07-31 10:41:38.293398] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option iam-self-heal-daemon using default value off >[2018-07-31 10:41:38.293423] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-replicate-1: option heal-timeout using default value 600 >[2018-07-31 10:41:38.293449] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option consistent-metadata using default value no >[2018-07-31 10:41:38.293475] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-1: option consistent-io using default value no >[2018-07-31 10:41:38.293502] D [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-1: option afr-pending-xattr using set value master-client-2,master-client-3 >[2018-07-31 10:41:38.294772] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option arbiter-count not set >[2018-07-31 10:41:38.294803] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-0: option thin-arbiter not set >[2018-07-31 10:41:38.294828] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-0: option afr-dirty-xattr using default value trusted.afr.dirty >[2018-07-31 10:41:38.294868] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option metadata-splitbrain-forced-heal using default value off >[2018-07-31 10:41:38.294888] T [MSGID: 0] [options.c:1263:xlator_option_init_xlator] 0-master-replicate-0: option read-subvolume not set >[2018-07-31 10:41:38.294906] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-replicate-0: option read-subvolume-index using default value -1 >[2018-07-31 10:41:38.294924] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-replicate-0: no range check required for 'option read-subvolume-index -1' >[2018-07-31 10:41:38.294942] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option choose-local using default value true >[2018-07-31 10:41:38.294961] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option read-hash-mode using default value 1 >[2018-07-31 10:41:38.294989] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-0: option favorite-child-policy using default value none >[2018-07-31 10:41:38.295015] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option shd-max-threads using default value 1 >[2018-07-31 10:41:38.295041] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option shd-wait-qlength using default value 1024 >[2018-07-31 10:41:38.295060] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option background-self-heal-count using default value 8 >[2018-07-31 10:41:38.295081] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option heal-wait-queue-length using default value 128 >[2018-07-31 10:41:38.295101] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-0: option data-self-heal using default value on >[2018-07-31 10:41:38.295123] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-0: option data-self-heal-algorithm not set >[2018-07-31 10:41:38.295144] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option data-self-heal-window-size using default value 1 >[2018-07-31 10:41:38.295165] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option metadata-self-heal using default value on >[2018-07-31 10:41:38.295192] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option entry-self-heal using default value on >[2018-07-31 10:41:38.295212] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option halo-shd-max-latency using default value 99999 >[2018-07-31 10:41:38.295233] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option halo-max-latency using default value 5 >[2018-07-31 10:41:38.295254] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option halo-max-replicas using default value 99999 >[2018-07-31 10:41:38.295274] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option halo-min-replicas using default value 2 >[2018-07-31 10:41:38.295294] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option halo-enabled using default value False >[2018-07-31 10:41:38.295314] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option halo-nfsd-max-latency using default value 5 >[2018-07-31 10:41:38.295337] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option iam-nfs-daemon using default value off >[2018-07-31 10:41:38.295358] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option optimistic-change-log using default value on >[2018-07-31 10:41:38.295381] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option pre-op-compat using default value on >[2018-07-31 10:41:38.295407] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-0: option locking-scheme using default value full >[2018-07-31 10:41:38.295432] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option full-lock using default value yes >[2018-07-31 10:41:38.295459] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option granular-entry-heal using default value no >[2018-07-31 10:41:38.295481] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option eager-lock using default value on >[2018-07-31 10:41:38.295504] T [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-0: option quorum-type using default value none >[2018-07-31 10:41:38.295527] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option quorum-count not set >[2018-07-31 10:41:38.295551] T [MSGID: 0] [options.c:1259:xlator_option_init_size_uint64] 0-master-replicate-0: option self-heal-readdir-size using default value 1KB >[2018-07-31 10:41:38.295576] T [MSGID: 0] [options.c:1256:xlator_option_init_uint32] 0-master-replicate-0: option post-op-delay-secs using default value 1 >[2018-07-31 10:41:38.295601] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option ensure-durability using default value on >[2018-07-31 10:41:38.295624] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option self-heal-daemon using default value on >[2018-07-31 10:41:38.295647] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option iam-self-heal-daemon using default value off >[2018-07-31 10:41:38.295672] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-replicate-0: option heal-timeout using default value 600 >[2018-07-31 10:41:38.295698] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option consistent-metadata using default value no >[2018-07-31 10:41:38.295725] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-replicate-0: option consistent-io using default value no >[2018-07-31 10:41:38.295751] D [MSGID: 0] [options.c:1253:xlator_option_init_str] 0-master-replicate-0: option afr-pending-xattr using set value master-client-0,master-client-1 >[2018-07-31 10:41:38.296986] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-3: option event-threads using default value 2 >[2018-07-31 10:41:38.297092] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-3: option frame-timeout using default value 1800 >[2018-07-31 10:41:38.297131] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-3: option remote-port not set >[2018-07-31 10:41:38.297140] I [MSGID: 101190] [event-epoll.c:617:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 >[2018-07-31 10:41:38.297153] D [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-3: option ping-timeout using set value 42 >[2018-07-31 10:41:38.297206] D [MSGID: 0] [options.c:1264:xlator_option_init_path] 0-master-client-3: option remote-subvolume using set value /d/backends/master4 >[2018-07-31 10:41:38.297228] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-client-3: option filter-O_DIRECT using default value disable >[2018-07-31 10:41:38.297250] D [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-client-3: option send-gids using set value true >[2018-07-31 10:41:38.297276] D [rpc-clnt.c:1030:rpc_clnt_connection_init] 0-master-client-3: defaulting frame-timeout to 30mins >[2018-07-31 10:41:38.297295] D [rpc-clnt.c:1039:rpc_clnt_connection_init] 0-master-client-3: setting ping-timeout to 42 >[2018-07-31 10:41:38.297315] D [rpc-transport.c:280:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so >[2018-07-31 10:41:38.297410] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-3: no range check required for 'option transport.tcp-user-timeout 0' >[2018-07-31 10:41:38.297438] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-3: no range check required for 'option transport.socket.keepalive-time 20' >[2018-07-31 10:41:38.297463] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-3: no range check required for 'option transport.socket.keepalive-interval 2' >[2018-07-31 10:41:38.297488] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-3: no range check required for 'option transport.socket.keepalive-count 9' >[2018-07-31 10:41:38.297516] D [socket.c:4684:socket_init] 0-master-client-3: Configued transport.tcp-user-timeout=0 >[2018-07-31 10:41:38.297532] D [socket.c:4702:socket_init] 0-master-client-3: Reconfigued transport.keepalivecnt=9 >[2018-07-31 10:41:38.297547] D [socket.c:4370:ssl_setup_connection_params] 0-master-client-3: SSL support on the I/O path is NOT enabled >[2018-07-31 10:41:38.297560] D [socket.c:4373:ssl_setup_connection_params] 0-master-client-3: SSL support for glusterd is NOT enabled >[2018-07-31 10:41:38.297578] D [rpc-clnt.c:1613:rpcclnt_cbk_program_register] 0-master-client-3: New program registered: GlusterFS Callback, Num: 52743234, Ver: 1 >[2018-07-31 10:41:38.297593] D [MSGID: 0] [client.c:2527:client_init_rpc] 0-master-client-3: client init successful >[2018-07-31 10:41:38.297635] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-2: option event-threads using default value 2 >[2018-07-31 10:41:38.297658] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-2: option frame-timeout using default value 1800 >[2018-07-31 10:41:38.297678] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-2: option remote-port not set >[2018-07-31 10:41:38.297697] D [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-2: option ping-timeout using set value 42 >[2018-07-31 10:41:38.297716] D [MSGID: 0] [options.c:1264:xlator_option_init_path] 0-master-client-2: option remote-subvolume using set value /d/backends/master3 >[2018-07-31 10:41:38.297736] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-client-2: option filter-O_DIRECT using default value disable >[2018-07-31 10:41:38.297757] D [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-client-2: option send-gids using set value true >[2018-07-31 10:41:38.297777] D [rpc-clnt.c:1030:rpc_clnt_connection_init] 0-master-client-2: defaulting frame-timeout to 30mins >[2018-07-31 10:41:38.297791] D [rpc-clnt.c:1039:rpc_clnt_connection_init] 0-master-client-2: setting ping-timeout to 42 >[2018-07-31 10:41:38.297815] D [rpc-transport.c:280:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so >[2018-07-31 10:41:38.297923] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-2: no range check required for 'option transport.tcp-user-timeout 0' >[2018-07-31 10:41:38.297953] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-2: no range check required for 'option transport.socket.keepalive-time 20' >[2018-07-31 10:41:38.297978] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-2: no range check required for 'option transport.socket.keepalive-interval 2' >[2018-07-31 10:41:38.298003] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-2: no range check required for 'option transport.socket.keepalive-count 9' >[2018-07-31 10:41:38.298031] D [socket.c:4684:socket_init] 0-master-client-2: Configued transport.tcp-user-timeout=0 >[2018-07-31 10:41:38.298046] D [socket.c:4702:socket_init] 0-master-client-2: Reconfigued transport.keepalivecnt=9 >[2018-07-31 10:41:38.298061] D [socket.c:4370:ssl_setup_connection_params] 0-master-client-2: SSL support on the I/O path is NOT enabled >[2018-07-31 10:41:38.298073] D [socket.c:4373:ssl_setup_connection_params] 0-master-client-2: SSL support for glusterd is NOT enabled >[2018-07-31 10:41:38.298090] D [rpc-clnt.c:1613:rpcclnt_cbk_program_register] 0-master-client-2: New program registered: GlusterFS Callback, Num: 52743234, Ver: 1 >[2018-07-31 10:41:38.298104] D [MSGID: 0] [client.c:2527:client_init_rpc] 0-master-client-2: client init successful >[2018-07-31 10:41:38.298147] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-1: option event-threads using default value 2 >[2018-07-31 10:41:38.298169] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-1: option frame-timeout using default value 1800 >[2018-07-31 10:41:38.298189] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-1: option remote-port not set >[2018-07-31 10:41:38.298208] D [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-1: option ping-timeout using set value 42 >[2018-07-31 10:41:38.298228] D [MSGID: 0] [options.c:1264:xlator_option_init_path] 0-master-client-1: option remote-subvolume using set value /d/backends/master2 >[2018-07-31 10:41:38.298248] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-client-1: option filter-O_DIRECT using default value disable >[2018-07-31 10:41:38.298269] D [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-client-1: option send-gids using set value true >[2018-07-31 10:41:38.298289] D [rpc-clnt.c:1030:rpc_clnt_connection_init] 0-master-client-1: defaulting frame-timeout to 30mins >[2018-07-31 10:41:38.298306] D [rpc-clnt.c:1039:rpc_clnt_connection_init] 0-master-client-1: setting ping-timeout to 42 >[2018-07-31 10:41:38.298327] D [rpc-transport.c:280:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so >[2018-07-31 10:41:38.298413] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-1: no range check required for 'option transport.tcp-user-timeout 0' >[2018-07-31 10:41:38.298439] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-1: no range check required for 'option transport.socket.keepalive-time 20' >[2018-07-31 10:41:38.298464] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-1: no range check required for 'option transport.socket.keepalive-interval 2' >[2018-07-31 10:41:38.298489] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-1: no range check required for 'option transport.socket.keepalive-count 9' >[2018-07-31 10:41:38.298516] D [socket.c:4684:socket_init] 0-master-client-1: Configued transport.tcp-user-timeout=0 >[2018-07-31 10:41:38.298531] D [socket.c:4702:socket_init] 0-master-client-1: Reconfigued transport.keepalivecnt=9 >[2018-07-31 10:41:38.298546] D [socket.c:4370:ssl_setup_connection_params] 0-master-client-1: SSL support on the I/O path is NOT enabled >[2018-07-31 10:41:38.298564] D [socket.c:4373:ssl_setup_connection_params] 0-master-client-1: SSL support for glusterd is NOT enabled >[2018-07-31 10:41:38.298581] D [rpc-clnt.c:1613:rpcclnt_cbk_program_register] 0-master-client-1: New program registered: GlusterFS Callback, Num: 52743234, Ver: 1 >[2018-07-31 10:41:38.298595] D [MSGID: 0] [client.c:2527:client_init_rpc] 0-master-client-1: client init successful >[2018-07-31 10:41:38.298639] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-0: option event-threads using default value 2 >[2018-07-31 10:41:38.298661] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-0: option frame-timeout using default value 1800 >[2018-07-31 10:41:38.298681] T [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-0: option remote-port not set >[2018-07-31 10:41:38.298700] D [MSGID: 0] [options.c:1257:xlator_option_init_int32] 0-master-client-0: option ping-timeout using set value 42 >[2018-07-31 10:41:38.298720] D [MSGID: 0] [options.c:1264:xlator_option_init_path] 0-master-client-0: option remote-subvolume using set value /d/backends/master1 >[2018-07-31 10:41:38.298740] T [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-client-0: option filter-O_DIRECT using default value disable >[2018-07-31 10:41:38.298760] D [MSGID: 0] [options.c:1262:xlator_option_init_bool] 0-master-client-0: option send-gids using set value true >[2018-07-31 10:41:38.298780] D [rpc-clnt.c:1030:rpc_clnt_connection_init] 0-master-client-0: defaulting frame-timeout to 30mins >[2018-07-31 10:41:38.298794] D [rpc-clnt.c:1039:rpc_clnt_connection_init] 0-master-client-0: setting ping-timeout to 42 >[2018-07-31 10:41:38.298817] D [rpc-transport.c:280:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so >[2018-07-31 10:41:38.298913] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-0: no range check required for 'option transport.tcp-user-timeout 0' >[2018-07-31 10:41:38.298943] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-0: no range check required for 'option transport.socket.keepalive-time 20' >[2018-07-31 10:41:38.298968] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-0: no range check required for 'option transport.socket.keepalive-interval 2' >[2018-07-31 10:41:38.298992] T [MSGID: 0] [options.c:86:xlator_option_validate_int] 0-master-client-0: no range check required for 'option transport.socket.keepalive-count 9' >[2018-07-31 10:41:38.299020] D [socket.c:4684:socket_init] 0-master-client-0: Configued transport.tcp-user-timeout=0 >[2018-07-31 10:41:38.299035] D [socket.c:4702:socket_init] 0-master-client-0: Reconfigued transport.keepalivecnt=9 >[2018-07-31 10:41:38.299050] D [socket.c:4370:ssl_setup_connection_params] 0-master-client-0: SSL support on the I/O path is NOT enabled >[2018-07-31 10:41:38.299062] D [socket.c:4373:ssl_setup_connection_params] 0-master-client-0: SSL support for glusterd is NOT enabled >[2018-07-31 10:41:38.299078] D [rpc-clnt.c:1613:rpcclnt_cbk_program_register] 0-master-client-0: New program registered: GlusterFS Callback, Num: 52743234, Ver: 1 >[2018-07-31 10:41:38.299092] D [MSGID: 0] [client.c:2527:client_init_rpc] 0-master-client-0: client init successful >[2018-07-31 10:41:38.299175] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-3: option 'transport.address-family' is not recognized >[2018-07-31 10:41:38.299197] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-3: option 'transport.tcp-user-timeout' is not recognized >[2018-07-31 10:41:38.299217] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-3: option 'transport.socket.keepalive-time' is not recognized >[2018-07-31 10:41:38.299237] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-3: option 'transport.socket.keepalive-interval' is not recognized >[2018-07-31 10:41:38.299256] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-3: option 'transport.socket.keepalive-count' is not recognized >[2018-07-31 10:41:38.299289] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-2: option 'transport.address-family' is not recognized >[2018-07-31 10:41:38.299310] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-2: option 'transport.tcp-user-timeout' is not recognized >[2018-07-31 10:41:38.299329] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-2: option 'transport.socket.keepalive-time' is not recognized >[2018-07-31 10:41:38.299349] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-2: option 'transport.socket.keepalive-interval' is not recognized >[2018-07-31 10:41:38.299368] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-2: option 'transport.socket.keepalive-count' is not recognized >[2018-07-31 10:41:38.299394] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-1: option 'transport.address-family' is not recognized >[2018-07-31 10:41:38.299415] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-1: option 'transport.tcp-user-timeout' is not recognized >[2018-07-31 10:41:38.299435] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-1: option 'transport.socket.keepalive-time' is not recognized >[2018-07-31 10:41:38.299455] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-1: option 'transport.socket.keepalive-interval' is not recognized >[2018-07-31 10:41:38.299474] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-1: option 'transport.socket.keepalive-count' is not recognized >[2018-07-31 10:41:38.299500] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-0: option 'transport.address-family' is not recognized >[2018-07-31 10:41:38.299520] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-0: option 'transport.tcp-user-timeout' is not recognized >[2018-07-31 10:41:38.299540] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-0: option 'transport.socket.keepalive-time' is not recognized >[2018-07-31 10:41:38.299559] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-0: option 'transport.socket.keepalive-interval' is not recognized >[2018-07-31 10:41:38.299579] W [MSGID: 101174] [graph.c:403:_log_if_unknown_option] 0-master-client-0: option 'transport.socket.keepalive-count' is not recognized >[2018-07-31 10:41:38.299609] D [fuse-bridge.c:5407:notify] 0-fuse: got event 12 on graph 0 >[2018-07-31 10:41:38.299665] D [MSGID: 0] [afr-common.c:5013:__afr_launch_notify_timer] 0-master-replicate-0: Initiating child-down timer >[2018-07-31 10:41:38.299691] I [MSGID: 114020] [client.c:2329:notify] 0-master-client-0: parent translators are ready, attempting connect on transport >[2018-07-31 10:41:38.299708] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-0: attempting reconnect >[2018-07-31 10:41:38.299721] T [socket.c:3409:socket_connect] 0-master-client-0: connecting 0x7f36f0078be0, sock=-1 >[2018-07-31 10:41:38.299737] T [name.c:243:af_inet_client_get_remote_sockaddr] 0-master-client-0: option remote-port missing in volume master-client-0. Defaulting to 24007 >[2018-07-31 10:41:38.299753] T [MSGID: 0] [common-utils.c:299:gf_resolve_ip6] 0-resolver: DNS cache not present, freshly probing hostname: builderhrk500.cloud.gluster.org >[2018-07-31 10:41:38.303060] D [MSGID: 0] [common-utils.c:339:gf_resolve_ip6] 0-resolver: returning ip-23.253.56.86 (port-24007) for hostname: builderhrk500.cloud.gluster.org and port: 24007 >[2018-07-31 10:41:38.306017] D [MSGID: 0] [common-utils.c:360:gf_resolve_ip6] 0-resolver: next DNS query will return: ip-104.130.69.104 port-24007 >[2018-07-31 10:41:38.306050] D [socket.c:3329:socket_fix_ssl_opts] 0-master-client-0: disabling SSL for portmapper connection >[2018-07-31 10:41:38.306096] T [socket.c:961:__socket_nodelay] 0-master-client-0: NODELAY enabled for socket 12 >[2018-07-31 10:41:38.306119] T [socket.c:1049:__socket_keepalive] 0-master-client-0: Keep-alive enabled for socket: 12, (idle: 20, interval: 2, max-probes: 9, timeout: 0) >[2018-07-31 10:41:38.306187] T [socket.c:3541:socket_connect] 0-master-client-0: >>> connect() with non-blocking IO for ALL >[2018-07-31 10:41:38.306213] T [socket.c:236:socket_dump_info] 0-master-client-0: $$$ client: connecting to (af:2,sock:12) 23.253.56.86 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.306302] I [MSGID: 114020] [client.c:2329:notify] 0-master-client-1: parent translators are ready, attempting connect on transport >[2018-07-31 10:41:38.306326] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-1: attempting reconnect >[2018-07-31 10:41:38.306341] T [socket.c:3409:socket_connect] 0-master-client-1: connecting 0x7f36f0073af0, sock=-1 >[2018-07-31 10:41:38.306330] T [socket.c:2960:socket_event_handler] 0-master-client-0: client (sock:12) in:0, out:4, err:0 >[2018-07-31 10:41:38.306404] T [socket.c:2968:socket_event_handler] 0-master-client-0: client (sock:12) socket is not connected, completing connection >[2018-07-31 10:41:38.306358] T [name.c:243:af_inet_client_get_remote_sockaddr] 0-master-client-1: option remote-port missing in volume master-client-1. Defaulting to 24007 >[2018-07-31 10:41:38.306466] T [MSGID: 0] [common-utils.c:299:gf_resolve_ip6] 0-resolver: DNS cache not present, freshly probing hostname: builderhrk500.cloud.gluster.org >[2018-07-31 10:41:38.306484] D [MSGID: 0] [client.c:2232:client_rpc_notify] 0-master-client-0: got RPC_CLNT_CONNECT >[2018-07-31 10:41:38.306586] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 72, payload: 8, rpc hdr: 64 >[2018-07-31 10:41:38.306673] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x2 Program: GF-DUMP, ProgVers: 1, Proc: 1) to rpc-transport (master-client-0) >[2018-07-31 10:41:38.307078] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/libgfrpc.so.0(+0x1743d)[0x7f370375443d] (--> /usr/local/lib/libgfrpc.so.0(+0x17c41)[0x7f3703754c41] (--> /usr/local/lib/libgfrpc.so.0(+0x17e14)[0x7f3703754e14] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_submit+0x51a)[0x7f3703750277] ))))) 0-: 23.253.56.86:24007: ping timer event already removed >[2018-07-31 10:41:38.307120] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 64, payload: 0, rpc hdr: 64 >[2018-07-31 10:41:38.307167] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x3 Program: GF-DUMP, ProgVers: 1, Proc: 2) to rpc-transport (master-client-0) >[2018-07-31 10:41:38.307191] T [socket.c:2874:socket_handle_client_connection_attempt] 0-master-client-0: socket_connect_finish() returned 0 >[2018-07-31 10:41:38.307209] T [socket.c:2974:socket_event_handler] 0-master-client-0: (sock:12) socket_complete_connection() returned 1 >[2018-07-31 10:41:38.307223] T [socket.c:2979:socket_event_handler] 0-master-client-0: (sock:12) returning to wait on socket >[2018-07-31 10:41:38.307239] T [socket.c:2960:socket_event_handler] 0-master-client-0: client (sock:12) in:0, out:4, err:0 >[2018-07-31 10:41:38.307252] T [socket.c:2988:socket_event_handler] 0-master-client-0: Client socket (12) is already connected >[2018-07-31 10:41:38.307268] T [socket.c:2996:socket_event_handler] 0-master-client-0: (sock:12) socket_event_poll_out returned 0 >[2018-07-31 10:41:38.308033] T [socket.c:2960:socket_event_handler] 0-master-client-0: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.308054] T [socket.c:2988:socket_event_handler] 0-master-client-0: Client socket (12) is already connected >[2018-07-31 10:41:38.308069] T [socket.c:528:__socket_ssl_readv] 0-master-client-0: ***** reading over non-SSL >[2018-07-31 10:41:38.308087] T [socket.c:528:__socket_ssl_readv] 0-master-client-0: ***** reading over non-SSL >[2018-07-31 10:41:38.308114] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-0: received rpc message (RPC XID: 0x2 Program: GF-DUMP, ProgVers: 1, Proc: 1) from rpc-transport (master-client-0) >[2018-07-31 10:41:38.308145] D [MSGID: 0] [client-handshake.c:1465:server_has_portmap] 0-master-client-0: detected portmapper on server >[2018-07-31 10:41:38.308198] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 88, payload: 24, rpc hdr: 64 >[2018-07-31 10:41:38.308235] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x4 Program: PORTMAP, ProgVers: 1, Proc: 1) to rpc-transport (master-client-0) >[2018-07-31 10:41:38.308263] T [socket.c:3002:socket_event_handler] 0-master-client-0: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.308280] T [socket.c:2960:socket_event_handler] 0-master-client-0: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.308293] T [socket.c:2988:socket_event_handler] 0-master-client-0: Client socket (12) is already connected >[2018-07-31 10:41:38.308306] T [socket.c:528:__socket_ssl_readv] 0-master-client-0: ***** reading over non-SSL >[2018-07-31 10:41:38.308323] T [socket.c:528:__socket_ssl_readv] 0-master-client-0: ***** reading over non-SSL >[2018-07-31 10:41:38.308348] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-0: received rpc message (RPC XID: 0x3 Program: GF-DUMP, ProgVers: 1, Proc: 2) from rpc-transport (master-client-0) >[2018-07-31 10:41:38.308367] D [rpc-clnt-ping.c:210:rpc_clnt_ping_cbk] 0-master-client-0: Ping latency is 1ms >[2018-07-31 10:41:38.308399] T [socket.c:3002:socket_event_handler] 0-master-client-0: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.308489] T [socket.c:2960:socket_event_handler] 0-master-client-0: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.308507] T [socket.c:2988:socket_event_handler] 0-master-client-0: Client socket (12) is already connected >[2018-07-31 10:41:38.308521] T [socket.c:528:__socket_ssl_readv] 0-master-client-0: ***** reading over non-SSL >[2018-07-31 10:41:38.308538] T [socket.c:528:__socket_ssl_readv] 0-master-client-0: ***** reading over non-SSL >[2018-07-31 10:41:38.308563] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-0: received rpc message (RPC XID: 0x4 Program: PORTMAP, ProgVers: 1, Proc: 1) from rpc-transport (master-client-0) >[2018-07-31 10:41:38.308584] I [rpc-clnt.c:2087:rpc_clnt_reconfig] 0-master-client-0: changing port to 49152 (from 0) >[2018-07-31 10:41:38.308606] T [socket.c:861:__socket_disconnect] 0-master-client-0: disconnecting 0x7f36f0078be0, sock=12 >[2018-07-31 10:41:38.308819] T [socket.c:865:__socket_disconnect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0x608e)[0x7f36f810d08e] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe02b)[0x7f36f811502b] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_disconnect+0x96)[0x7f370374a45b] (--> /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so(+0x54292)[0x7f36f5e0f292] ))))) 0-master-client-0: tearing down socket connection >[2018-07-31 10:41:38.308877] T [socket.c:3002:socket_event_handler] 0-master-client-0: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.308898] T [socket.c:2960:socket_event_handler] 0-master-client-0: client (sock:12) in:1, out:0, err:16 >[2018-07-31 10:41:38.308923] T [socket.c:236:socket_dump_info] 0-master-client-0: $$$ client: disconnecting from (af:2,sock:12) 23.253.56.86 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.308938] D [socket.c:3021:socket_event_handler] 0-transport: EPOLLERR - disconnecting (sock:12) (non-SSL) >[2018-07-31 10:41:38.308959] D [MSGID: 0] [client.c:2242:client_rpc_notify] 0-master-client-0: got RPC_CLNT_DISCONNECT >[2018-07-31 10:41:38.308977] D [MSGID: 0] [client.c:2284:client_rpc_notify] 0-master-client-0: disconnected (skipped notify) >[2018-07-31 10:41:38.308997] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-0: attempting reconnect >[2018-07-31 10:41:38.309011] T [socket.c:3409:socket_connect] 0-master-client-0: connecting 0x7f36f0078be0, sock=-1 >[2018-07-31 10:41:38.309028] T [name.c:243:af_inet_client_get_remote_sockaddr] 0-master-client-0: option remote-port missing in volume master-client-0. Defaulting to 24007 >[2018-07-31 10:41:38.309568] D [MSGID: 0] [common-utils.c:339:gf_resolve_ip6] 0-resolver: returning ip-23.253.56.86 (port-24007) for hostname: builderhrk500.cloud.gluster.org and port: 24007 >[2018-07-31 10:41:38.312685] D [MSGID: 0] [common-utils.c:339:gf_resolve_ip6] 0-resolver: returning ip-104.130.69.104 (port-24007) for hostname: builderhrk500.cloud.gluster.org and port: 24007 >[2018-07-31 10:41:38.312749] T [socket.c:961:__socket_nodelay] 0-master-client-0: NODELAY enabled for socket 14 >[2018-07-31 10:41:38.312779] T [socket.c:1049:__socket_keepalive] 0-master-client-0: Keep-alive enabled for socket: 14, (idle: 20, interval: 2, max-probes: 9, timeout: 0) >[2018-07-31 10:41:38.312858] T [socket.c:3541:socket_connect] 0-master-client-0: >>> connect() with non-blocking IO for ALL >[2018-07-31 10:41:38.312883] T [socket.c:236:socket_dump_info] 0-master-client-0: $$$ client: connecting to (af:2,sock:14) 104.130.69.104 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.315664] D [MSGID: 0] [common-utils.c:360:gf_resolve_ip6] 0-resolver: next DNS query will return: ip-104.130.69.104 port-24007 >[2018-07-31 10:41:38.315694] D [socket.c:3329:socket_fix_ssl_opts] 0-master-client-1: disabling SSL for portmapper connection >[2018-07-31 10:41:38.315730] T [socket.c:961:__socket_nodelay] 0-master-client-1: NODELAY enabled for socket 12 >[2018-07-31 10:41:38.315752] T [socket.c:1049:__socket_keepalive] 0-master-client-1: Keep-alive enabled for socket: 12, (idle: 20, interval: 2, max-probes: 9, timeout: 0) >[2018-07-31 10:41:38.315805] T [socket.c:3541:socket_connect] 0-master-client-1: >>> connect() with non-blocking IO for ALL >[2018-07-31 10:41:38.315828] T [socket.c:236:socket_dump_info] 0-master-client-1: $$$ client: connecting to (af:2,sock:12) 23.253.56.86 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.315914] D [MSGID: 0] [afr-common.c:5013:__afr_launch_notify_timer] 0-master-replicate-1: Initiating child-down timer >[2018-07-31 10:41:38.315943] I [MSGID: 114020] [client.c:2329:notify] 0-master-client-2: parent translators are ready, attempting connect on transport >[2018-07-31 10:41:38.315960] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-2: attempting reconnect >[2018-07-31 10:41:38.315963] T [socket.c:2960:socket_event_handler] 0-master-client-1: client (sock:12) in:0, out:4, err:0 >[2018-07-31 10:41:38.315999] T [socket.c:2968:socket_event_handler] 0-master-client-1: client (sock:12) socket is not connected, completing connection >[2018-07-31 10:41:38.315974] T [socket.c:3409:socket_connect] 0-master-client-2: connecting 0x7f36f006ea80, sock=-1 >[2018-07-31 10:41:38.316031] D [MSGID: 0] [client.c:2232:client_rpc_notify] 0-master-client-1: got RPC_CLNT_CONNECT >[2018-07-31 10:41:38.316048] T [name.c:243:af_inet_client_get_remote_sockaddr] 0-master-client-2: option remote-port missing in volume master-client-2. Defaulting to 24007 >[2018-07-31 10:41:38.316064] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 72, payload: 8, rpc hdr: 64 >[2018-07-31 10:41:38.316068] T [MSGID: 0] [common-utils.c:299:gf_resolve_ip6] 0-resolver: DNS cache not present, freshly probing hostname: builderhrk500.cloud.gluster.org >[2018-07-31 10:41:38.316112] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x2 Program: GF-DUMP, ProgVers: 1, Proc: 1) to rpc-transport (master-client-1) >[2018-07-31 10:41:38.316321] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/libgfrpc.so.0(+0x1743d)[0x7f370375443d] (--> /usr/local/lib/libgfrpc.so.0(+0x17c41)[0x7f3703754c41] (--> /usr/local/lib/libgfrpc.so.0(+0x17e14)[0x7f3703754e14] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_submit+0x51a)[0x7f3703750277] ))))) 0-: 23.253.56.86:24007: ping timer event already removed >[2018-07-31 10:41:38.316357] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 64, payload: 0, rpc hdr: 64 >[2018-07-31 10:41:38.316395] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x3 Program: GF-DUMP, ProgVers: 1, Proc: 2) to rpc-transport (master-client-1) >[2018-07-31 10:41:38.316421] T [socket.c:2874:socket_handle_client_connection_attempt] 0-master-client-1: socket_connect_finish() returned 0 >[2018-07-31 10:41:38.316438] T [socket.c:2974:socket_event_handler] 0-master-client-1: (sock:12) socket_complete_connection() returned 1 >[2018-07-31 10:41:38.316452] T [socket.c:2979:socket_event_handler] 0-master-client-1: (sock:12) returning to wait on socket >[2018-07-31 10:41:38.316467] T [socket.c:2960:socket_event_handler] 0-master-client-1: client (sock:12) in:0, out:4, err:0 >[2018-07-31 10:41:38.316480] T [socket.c:2988:socket_event_handler] 0-master-client-1: Client socket (12) is already connected >[2018-07-31 10:41:38.316495] T [socket.c:2996:socket_event_handler] 0-master-client-1: (sock:12) socket_event_poll_out returned 0 >[2018-07-31 10:41:38.316626] T [socket.c:2960:socket_event_handler] 0-master-client-1: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.316645] T [socket.c:2988:socket_event_handler] 0-master-client-1: Client socket (12) is already connected >[2018-07-31 10:41:38.316658] T [socket.c:528:__socket_ssl_readv] 0-master-client-1: ***** reading over non-SSL >[2018-07-31 10:41:38.316675] T [socket.c:528:__socket_ssl_readv] 0-master-client-1: ***** reading over non-SSL >[2018-07-31 10:41:38.316701] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-1: received rpc message (RPC XID: 0x2 Program: GF-DUMP, ProgVers: 1, Proc: 1) from rpc-transport (master-client-1) >[2018-07-31 10:41:38.316722] D [MSGID: 0] [client-handshake.c:1465:server_has_portmap] 0-master-client-1: detected portmapper on server >[2018-07-31 10:41:38.316751] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 88, payload: 24, rpc hdr: 64 >[2018-07-31 10:41:38.316785] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x4 Program: PORTMAP, ProgVers: 1, Proc: 1) to rpc-transport (master-client-1) >[2018-07-31 10:41:38.316806] T [socket.c:3002:socket_event_handler] 0-master-client-1: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.316829] T [socket.c:2960:socket_event_handler] 0-master-client-1: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.316866] T [socket.c:2988:socket_event_handler] 0-master-client-1: Client socket (12) is already connected >[2018-07-31 10:41:38.316882] T [socket.c:528:__socket_ssl_readv] 0-master-client-1: ***** reading over non-SSL >[2018-07-31 10:41:38.316899] T [socket.c:528:__socket_ssl_readv] 0-master-client-1: ***** reading over non-SSL >[2018-07-31 10:41:38.316924] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-1: received rpc message (RPC XID: 0x3 Program: GF-DUMP, ProgVers: 1, Proc: 2) from rpc-transport (master-client-1) >[2018-07-31 10:41:38.316941] D [rpc-clnt-ping.c:210:rpc_clnt_ping_cbk] 0-master-client-1: Ping latency is 0ms >[2018-07-31 10:41:38.316962] T [socket.c:3002:socket_event_handler] 0-master-client-1: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.317039] T [socket.c:2960:socket_event_handler] 0-master-client-1: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.317056] T [socket.c:2988:socket_event_handler] 0-master-client-1: Client socket (12) is already connected >[2018-07-31 10:41:38.317069] T [socket.c:528:__socket_ssl_readv] 0-master-client-1: ***** reading over non-SSL >[2018-07-31 10:41:38.317086] T [socket.c:528:__socket_ssl_readv] 0-master-client-1: ***** reading over non-SSL >[2018-07-31 10:41:38.317110] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-1: received rpc message (RPC XID: 0x4 Program: PORTMAP, ProgVers: 1, Proc: 1) from rpc-transport (master-client-1) >[2018-07-31 10:41:38.317126] I [rpc-clnt.c:2087:rpc_clnt_reconfig] 0-master-client-1: changing port to 49153 (from 0) >[2018-07-31 10:41:38.317140] T [socket.c:861:__socket_disconnect] 0-master-client-1: disconnecting 0x7f36f0073af0, sock=12 >[2018-07-31 10:41:38.317332] T [socket.c:865:__socket_disconnect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0x608e)[0x7f36f810d08e] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe02b)[0x7f36f811502b] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_disconnect+0x96)[0x7f370374a45b] (--> /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so(+0x54292)[0x7f36f5e0f292] ))))) 0-master-client-1: tearing down socket connection >[2018-07-31 10:41:38.317378] T [socket.c:3002:socket_event_handler] 0-master-client-1: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.317397] T [socket.c:2960:socket_event_handler] 0-master-client-1: client (sock:12) in:1, out:0, err:16 >[2018-07-31 10:41:38.317417] T [socket.c:236:socket_dump_info] 0-master-client-1: $$$ client: disconnecting from (af:2,sock:12) 23.253.56.86 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.317431] D [socket.c:3021:socket_event_handler] 0-transport: EPOLLERR - disconnecting (sock:12) (non-SSL) >[2018-07-31 10:41:38.317451] D [MSGID: 0] [client.c:2242:client_rpc_notify] 0-master-client-1: got RPC_CLNT_DISCONNECT >[2018-07-31 10:41:38.317469] D [MSGID: 0] [client.c:2284:client_rpc_notify] 0-master-client-1: disconnected (skipped notify) >[2018-07-31 10:41:38.317487] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-1: attempting reconnect >[2018-07-31 10:41:38.317500] T [socket.c:3409:socket_connect] 0-master-client-1: connecting 0x7f36f0073af0, sock=-1 >[2018-07-31 10:41:38.317516] T [name.c:243:af_inet_client_get_remote_sockaddr] 0-master-client-1: option remote-port missing in volume master-client-1. Defaulting to 24007 >[2018-07-31 10:41:38.319173] D [MSGID: 0] [common-utils.c:339:gf_resolve_ip6] 0-resolver: returning ip-23.253.56.86 (port-24007) for hostname: builderhrk500.cloud.gluster.org and port: 24007 >[2018-07-31 10:41:38.322134] D [MSGID: 0] [common-utils.c:339:gf_resolve_ip6] 0-resolver: returning ip-104.130.69.104 (port-24007) for hostname: builderhrk500.cloud.gluster.org and port: 24007 >[2018-07-31 10:41:38.322188] T [socket.c:961:__socket_nodelay] 0-master-client-1: NODELAY enabled for socket 15 >[2018-07-31 10:41:38.322212] T [socket.c:1049:__socket_keepalive] 0-master-client-1: Keep-alive enabled for socket: 15, (idle: 20, interval: 2, max-probes: 9, timeout: 0) >[2018-07-31 10:41:38.322269] T [socket.c:3541:socket_connect] 0-master-client-1: >>> connect() with non-blocking IO for ALL >[2018-07-31 10:41:38.322290] T [socket.c:236:socket_dump_info] 0-master-client-1: $$$ client: connecting to (af:2,sock:15) 104.130.69.104 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.325360] D [MSGID: 0] [common-utils.c:360:gf_resolve_ip6] 0-resolver: next DNS query will return: ip-104.130.69.104 port-24007 >[2018-07-31 10:41:38.325385] D [socket.c:3329:socket_fix_ssl_opts] 0-master-client-2: disabling SSL for portmapper connection >[2018-07-31 10:41:38.325420] T [socket.c:961:__socket_nodelay] 0-master-client-2: NODELAY enabled for socket 12 >[2018-07-31 10:41:38.325442] T [socket.c:1049:__socket_keepalive] 0-master-client-2: Keep-alive enabled for socket: 12, (idle: 20, interval: 2, max-probes: 9, timeout: 0) >[2018-07-31 10:41:38.325499] T [socket.c:3541:socket_connect] 0-master-client-2: >>> connect() with non-blocking IO for ALL >[2018-07-31 10:41:38.325520] T [socket.c:236:socket_dump_info] 0-master-client-2: $$$ client: connecting to (af:2,sock:12) 23.253.56.86 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.325587] I [MSGID: 114020] [client.c:2329:notify] 0-master-client-3: parent translators are ready, attempting connect on transport >[2018-07-31 10:41:38.325609] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-3: attempting reconnect >[2018-07-31 10:41:38.325622] T [socket.c:3409:socket_connect] 0-master-client-3: connecting 0x7f36f0069940, sock=-1 >[2018-07-31 10:41:38.325639] T [name.c:243:af_inet_client_get_remote_sockaddr] 0-master-client-3: option remote-port missing in volume master-client-3. Defaulting to 24007 >[2018-07-31 10:41:38.325639] T [socket.c:2960:socket_event_handler] 0-master-client-2: client (sock:12) in:0, out:4, err:0 >[2018-07-31 10:41:38.325688] T [socket.c:2968:socket_event_handler] 0-master-client-2: client (sock:12) socket is not connected, completing connection >[2018-07-31 10:41:38.325664] T [MSGID: 0] [common-utils.c:299:gf_resolve_ip6] 0-resolver: DNS cache not present, freshly probing hostname: builderhrk500.cloud.gluster.org >[2018-07-31 10:41:38.325747] D [MSGID: 0] [client.c:2232:client_rpc_notify] 0-master-client-2: got RPC_CLNT_CONNECT >[2018-07-31 10:41:38.325792] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 72, payload: 8, rpc hdr: 64 >[2018-07-31 10:41:38.325862] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x2 Program: GF-DUMP, ProgVers: 1, Proc: 1) to rpc-transport (master-client-2) >[2018-07-31 10:41:38.326106] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/libgfrpc.so.0(+0x1743d)[0x7f370375443d] (--> /usr/local/lib/libgfrpc.so.0(+0x17c41)[0x7f3703754c41] (--> /usr/local/lib/libgfrpc.so.0(+0x17e14)[0x7f3703754e14] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_submit+0x51a)[0x7f3703750277] ))))) 0-: 23.253.56.86:24007: ping timer event already removed >[2018-07-31 10:41:38.326142] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 64, payload: 0, rpc hdr: 64 >[2018-07-31 10:41:38.326183] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x3 Program: GF-DUMP, ProgVers: 1, Proc: 2) to rpc-transport (master-client-2) >[2018-07-31 10:41:38.326204] T [socket.c:2874:socket_handle_client_connection_attempt] 0-master-client-2: socket_connect_finish() returned 0 >[2018-07-31 10:41:38.326221] T [socket.c:2974:socket_event_handler] 0-master-client-2: (sock:12) socket_complete_connection() returned 1 >[2018-07-31 10:41:38.326234] T [socket.c:2979:socket_event_handler] 0-master-client-2: (sock:12) returning to wait on socket >[2018-07-31 10:41:38.326250] T [socket.c:2960:socket_event_handler] 0-master-client-2: client (sock:12) in:0, out:4, err:0 >[2018-07-31 10:41:38.326263] T [socket.c:2988:socket_event_handler] 0-master-client-2: Client socket (12) is already connected >[2018-07-31 10:41:38.326279] T [socket.c:2996:socket_event_handler] 0-master-client-2: (sock:12) socket_event_poll_out returned 0 >[2018-07-31 10:41:38.326428] T [socket.c:2960:socket_event_handler] 0-master-client-2: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.326446] T [socket.c:2988:socket_event_handler] 0-master-client-2: Client socket (12) is already connected >[2018-07-31 10:41:38.326459] T [socket.c:528:__socket_ssl_readv] 0-master-client-2: ***** reading over non-SSL >[2018-07-31 10:41:38.326477] T [socket.c:528:__socket_ssl_readv] 0-master-client-2: ***** reading over non-SSL >[2018-07-31 10:41:38.326504] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-2: received rpc message (RPC XID: 0x2 Program: GF-DUMP, ProgVers: 1, Proc: 1) from rpc-transport (master-client-2) >[2018-07-31 10:41:38.326525] D [MSGID: 0] [client-handshake.c:1465:server_has_portmap] 0-master-client-2: detected portmapper on server >[2018-07-31 10:41:38.326561] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 88, payload: 24, rpc hdr: 64 >[2018-07-31 10:41:38.326595] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x4 Program: PORTMAP, ProgVers: 1, Proc: 1) to rpc-transport (master-client-2) >[2018-07-31 10:41:38.326618] T [socket.c:3002:socket_event_handler] 0-master-client-2: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.326634] T [socket.c:2960:socket_event_handler] 0-master-client-2: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.326647] T [socket.c:2988:socket_event_handler] 0-master-client-2: Client socket (12) is already connected >[2018-07-31 10:41:38.326659] T [socket.c:528:__socket_ssl_readv] 0-master-client-2: ***** reading over non-SSL >[2018-07-31 10:41:38.326676] T [socket.c:528:__socket_ssl_readv] 0-master-client-2: ***** reading over non-SSL >[2018-07-31 10:41:38.326700] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-2: received rpc message (RPC XID: 0x3 Program: GF-DUMP, ProgVers: 1, Proc: 2) from rpc-transport (master-client-2) >[2018-07-31 10:41:38.326724] D [rpc-clnt-ping.c:210:rpc_clnt_ping_cbk] 0-master-client-2: Ping latency is 0ms >[2018-07-31 10:41:38.326746] T [socket.c:3002:socket_event_handler] 0-master-client-2: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.326828] T [socket.c:2960:socket_event_handler] 0-master-client-2: client (sock:12) in:1, out:0, err:0 >[2018-07-31 10:41:38.326862] T [socket.c:2988:socket_event_handler] 0-master-client-2: Client socket (12) is already connected >[2018-07-31 10:41:38.326876] T [socket.c:528:__socket_ssl_readv] 0-master-client-2: ***** reading over non-SSL >[2018-07-31 10:41:38.326893] T [socket.c:528:__socket_ssl_readv] 0-master-client-2: ***** reading over non-SSL >[2018-07-31 10:41:38.326918] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-2: received rpc message (RPC XID: 0x4 Program: PORTMAP, ProgVers: 1, Proc: 1) from rpc-transport (master-client-2) >[2018-07-31 10:41:38.326935] I [rpc-clnt.c:2087:rpc_clnt_reconfig] 0-master-client-2: changing port to 49154 (from 0) >[2018-07-31 10:41:38.326950] T [socket.c:861:__socket_disconnect] 0-master-client-2: disconnecting 0x7f36f006ea80, sock=12 >[2018-07-31 10:41:38.327138] T [socket.c:865:__socket_disconnect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0x608e)[0x7f36f810d08e] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe02b)[0x7f36f811502b] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_disconnect+0x96)[0x7f370374a45b] (--> /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so(+0x54292)[0x7f36f5e0f292] ))))) 0-master-client-2: tearing down socket connection >[2018-07-31 10:41:38.327180] T [socket.c:3002:socket_event_handler] 0-master-client-2: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.327199] T [socket.c:2960:socket_event_handler] 0-master-client-2: client (sock:12) in:1, out:0, err:16 >[2018-07-31 10:41:38.327219] T [socket.c:236:socket_dump_info] 0-master-client-2: $$$ client: disconnecting from (af:2,sock:12) 23.253.56.86 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.327233] D [socket.c:3021:socket_event_handler] 0-transport: EPOLLERR - disconnecting (sock:12) (non-SSL) >[2018-07-31 10:41:38.327256] D [MSGID: 0] [client.c:2242:client_rpc_notify] 0-master-client-2: got RPC_CLNT_DISCONNECT >[2018-07-31 10:41:38.327275] D [MSGID: 0] [client.c:2284:client_rpc_notify] 0-master-client-2: disconnected (skipped notify) >[2018-07-31 10:41:38.327293] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-2: attempting reconnect >[2018-07-31 10:41:38.327306] T [socket.c:3409:socket_connect] 0-master-client-2: connecting 0x7f36f006ea80, sock=-1 >[2018-07-31 10:41:38.327322] T [name.c:243:af_inet_client_get_remote_sockaddr] 0-master-client-2: option remote-port missing in volume master-client-2. Defaulting to 24007 >[2018-07-31 10:41:38.328952] D [MSGID: 0] [common-utils.c:339:gf_resolve_ip6] 0-resolver: returning ip-23.253.56.86 (port-24007) for hostname: builderhrk500.cloud.gluster.org and port: 24007 >[2018-07-31 10:41:38.331947] D [MSGID: 0] [common-utils.c:339:gf_resolve_ip6] 0-resolver: returning ip-104.130.69.104 (port-24007) for hostname: builderhrk500.cloud.gluster.org and port: 24007 >[2018-07-31 10:41:38.331996] T [socket.c:961:__socket_nodelay] 0-master-client-2: NODELAY enabled for socket 16 >[2018-07-31 10:41:38.332019] T [socket.c:1049:__socket_keepalive] 0-master-client-2: Keep-alive enabled for socket: 16, (idle: 20, interval: 2, max-probes: 9, timeout: 0) >[2018-07-31 10:41:38.332087] T [socket.c:3541:socket_connect] 0-master-client-2: >>> connect() with non-blocking IO for ALL >[2018-07-31 10:41:38.332108] T [socket.c:236:socket_dump_info] 0-master-client-2: $$$ client: connecting to (af:2,sock:16) 104.130.69.104 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.334879] D [MSGID: 0] [common-utils.c:360:gf_resolve_ip6] 0-resolver: next DNS query will return: ip-104.130.69.104 port-24007 >[2018-07-31 10:41:38.334905] D [socket.c:3329:socket_fix_ssl_opts] 0-master-client-3: disabling SSL for portmapper connection >[2018-07-31 10:41:38.334946] T [socket.c:961:__socket_nodelay] 0-master-client-3: NODELAY enabled for socket 12 >[2018-07-31 10:41:38.334968] T [socket.c:1049:__socket_keepalive] 0-master-client-3: Keep-alive enabled for socket: 12, (idle: 20, interval: 2, max-probes: 9, timeout: 0) >[2018-07-31 10:41:38.335033] T [socket.c:3541:socket_connect] 0-master-client-3: >>> connect() with non-blocking IO for ALL >[2018-07-31 10:41:38.335054] T [socket.c:236:socket_dump_info] 0-master-client-3: $$$ client: connecting to (af:2,sock:12) 23.253.56.86 non-SSL (errno:0:Success) >Final graph: >+------------------------------------------------------------------------------+ > 1: volume master-client-0 > 2: type protocol/client > 3: option ping-timeout 42 > 4: option remote-host builderhrk500.cloud.gluster.org > 5: option remote-subvolume /d/backends/master1 >[2018-07-31 10:41:38.335166] T [socket.c:2960:socket_event_handler] 0-master-client-3: client (sock:12) in:0, out:4, err:0 > 6: option transport-type socket > 7: option transport.address-family inet >[2018-07-31 10:41:38.335213] T [socket.c:2968:socket_event_handler] 0-master-client-3: client (sock:12) socket is not connected, completing connection > 8: option username c248d29d-56f8-4700-aa1f-0800ebe419a0 > 9: option password b922d56e-2aea-4284-9e6e-c3bc4b4cbb99 > 10: option transport.tcp-user-timeout 0 > 11: option transport.socket.keepalive-time 20 >[2018-07-31 10:41:38.335289] D [MSGID: 0] [client.c:2232:client_rpc_notify] 0-master-client-3: got RPC_CLNT_CONNECT > 12: option transport.socket.keepalive-interval 2 > 13: option transport.socket.keepalive-count 9 > 14: option send-gids true >[2018-07-31 10:41:38.335328] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 72, payload: 8, rpc hdr: 64 > 15: end-volume > 16: > 17: volume master-client-1 > 18: type protocol/client > 19: option ping-timeout 42 >[2018-07-31 10:41:38.335398] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x2 Program: GF-DUMP, ProgVers: 1, Proc: 1) to rpc-transport (master-client-3) > 20: option remote-host builderhrk500.cloud.gluster.org > 21: option remote-subvolume /d/backends/master2 > 22: option transport-type socket > 23: option transport.address-family inet > 24: option username c248d29d-56f8-4700-aa1f-0800ebe419a0 > 25: option password b922d56e-2aea-4284-9e6e-c3bc4b4cbb99 > 26: option transport.tcp-user-timeout 0 > 27: option transport.socket.keepalive-time 20 > 28: option transport.socket.keepalive-interval 2 > 29: option transport.socket.keepalive-count 9 > 30: option send-gids true > 31: end-volume > 32: > 33: volume master-replicate-0 > 34: type cluster/replicate > 35: option afr-pending-xattr master-client-0,master-client-1 > 36: option use-compound-fops off > 37: subvolumes master-client-0 master-client-1 > 38: end-volume > 39: > 40: volume master-client-2 > 41: type protocol/client > 42: option ping-timeout 42 > 43: option remote-host builderhrk500.cloud.gluster.org >[2018-07-31 10:41:38.335595] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/libgfrpc.so.0(+0x1743d)[0x7f370375443d] (--> /usr/local/lib/libgfrpc.so.0(+0x17c41)[0x7f3703754c41] (--> /usr/local/lib/libgfrpc.so.0(+0x17e14)[0x7f3703754e14] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_submit+0x51a)[0x7f3703750277] ))))) 0-: 23.253.56.86:24007: ping timer event already removed > 44: option remote-subvolume /d/backends/master3 > 45: option transport-type socket >[2018-07-31 10:41:38.335638] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 64, payload: 0, rpc hdr: 64 > 46: option transport.address-family inet > 47: option username c248d29d-56f8-4700-aa1f-0800ebe419a0 > 48: option password b922d56e-2aea-4284-9e6e-c3bc4b4cbb99 >[2018-07-31 10:41:38.335684] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x3 Program: GF-DUMP, ProgVers: 1, Proc: 2) to rpc-transport (master-client-3) > 49: option transport.tcp-user-timeout 0 >[2018-07-31 10:41:38.335717] T [socket.c:2874:socket_handle_client_connection_attempt] 0-master-client-3: socket_connect_finish() returned 0 > 50: option transport.socket.keepalive-time 20 > 51: option transport.socket.keepalive-interval 2 > 52: option transport.socket.keepalive-count 9 > 53: option send-gids true > 54: end-volume > 55: > 56: volume master-client-3 > 57: type protocol/client > 58: option ping-timeout 42 > 59: option remote-host builderhrk500.cloud.gluster.org > 60: option remote-subvolume /d/backends/master4 > 61: option transport-type socket > 62: option transport.address-family inet > 63: option username c248d29d-56f8-4700-aa1f-0800ebe419a0 > 64: option password b922d56e-2aea-4284-9e6e-c3bc4b4cbb99 > 65: option transport.tcp-user-timeout 0 > 66: option transport.socket.keepalive-time 20 > 67: option transport.socket.keepalive-interval 2 > 68: option transport.socket.keepalive-count 9 > 69: option send-gids true > 70: end-volume >[2018-07-31 10:41:38.335743] T [socket.c:2974:socket_event_handler] 0-master-client-3: (sock:12) socket_complete_connection() returned 1 > 71: > 72: volume master-replicate-1 >[2018-07-31 10:41:38.335936] T [socket.c:2979:socket_event_handler] 0-master-client-3: (sock:12) returning to wait on socket > 73: type cluster/replicate >[2018-07-31 10:41:38.335981] T [socket.c:2960:socket_event_handler] 0-master-client-3: client (sock:12) in:1, out:4, err:0 > 74: option afr-pending-xattr master-client-2,master-client-3 > 75: option use-compound-fops off > 76: subvolumes master-client-2 master-client-3 > 77: end-volume >[2018-07-31 10:41:38.336008] T [socket.c:2988:socket_event_handler] 0-master-client-3: Client socket (12) is already connected > 78: >[2018-07-31 10:41:38.336087] T [socket.c:2996:socket_event_handler] 0-master-client-3: (sock:12) socket_event_poll_out returned 0 > 79: volume master-dht > 80: type cluster/distribute >[2018-07-31 10:41:38.336115] T [socket.c:528:__socket_ssl_readv] 0-master-client-3: ***** reading over non-SSL > 81: option lock-migration off >[2018-07-31 10:41:38.336158] T [socket.c:528:__socket_ssl_readv] 0-master-client-3: ***** reading over non-SSL > 82: option force-migration off > 83: subvolumes master-replicate-0 master-replicate-1 >[2018-07-31 10:41:38.336192] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-3: received rpc message (RPC XID: 0x2 Program: GF-DUMP, ProgVers: 1, Proc: 1) from rpc-transport (master-client-3) > 84: end-volume > 85: > 86: volume master-write-behind >[2018-07-31 10:41:38.336220] D [MSGID: 0] [client-handshake.c:1465:server_has_portmap] 0-master-client-3: detected portmapper on server > 87: type performance/write-behind > 88: subvolumes master-dht >[2018-07-31 10:41:38.336276] T [rpc-clnt.c:1462:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 88, payload: 24, rpc hdr: 64 > 89: end-volume > 90: > 91: volume master-read-ahead > 92: type performance/read-ahead > 93: subvolumes master-write-behind > 94: end-volume > 95: > 96: volume master-readdir-ahead > 97: type performance/readdir-ahead > 98: option parallel-readdir off > 99: option rda-request-size 131072 >100: option rda-cache-limit 10MB >[2018-07-31 10:41:38.336320] T [rpc-clnt.c:1752:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x4 Program: PORTMAP, ProgVers: 1, Proc: 1) to rpc-transport (master-client-3) >101: subvolumes master-read-ahead >102: end-volume >103: >104: volume master-io-cache >105: type performance/io-cache >[2018-07-31 10:41:38.336419] T [socket.c:3002:socket_event_handler] 0-master-client-3: (sock:12) socket_event_poll_in returned 0 >106: subvolumes master-readdir-ahead >[2018-07-31 10:41:38.336482] T [socket.c:2960:socket_event_handler] 0-master-client-3: client (sock:12) in:1, out:0, err:0 >107: end-volume >108: >[2018-07-31 10:41:38.336504] T [socket.c:2988:socket_event_handler] 0-master-client-3: Client socket (12) is already connected >109: volume master-quick-read >110: type performance/quick-read >[2018-07-31 10:41:38.336548] T [socket.c:528:__socket_ssl_readv] 0-master-client-3: ***** reading over non-SSL >111: subvolumes master-io-cache >[2018-07-31 10:41:38.336591] T [socket.c:528:__socket_ssl_readv] 0-master-client-3: ***** reading over non-SSL >112: end-volume >113: >114: volume master-open-behind >115: type performance/open-behind >[2018-07-31 10:41:38.336625] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-3: received rpc message (RPC XID: 0x3 Program: GF-DUMP, ProgVers: 1, Proc: 2) from rpc-transport (master-client-3) >116: subvolumes master-quick-read >[2018-07-31 10:41:38.336669] D [rpc-clnt-ping.c:210:rpc_clnt_ping_cbk] 0-master-client-3: Ping latency is 1ms >117: end-volume >118: >119: volume master-md-cache >[2018-07-31 10:41:38.336706] T [socket.c:3002:socket_event_handler] 0-master-client-3: (sock:12) socket_event_poll_in returned 0 >120: type performance/md-cache >[2018-07-31 10:41:38.336747] T [socket.c:2960:socket_event_handler] 0-master-client-3: client (sock:12) in:1, out:0, err:0 >121: subvolumes master-open-behind >122: end-volume >[2018-07-31 10:41:38.336775] T [socket.c:2988:socket_event_handler] 0-master-client-3: Client socket (12) is already connected >123: >124: volume master >[2018-07-31 10:41:38.336814] T [socket.c:528:__socket_ssl_readv] 0-master-client-3: ***** reading over non-SSL >125: type debug/io-stats >[2018-07-31 10:41:38.336873] T [socket.c:528:__socket_ssl_readv] 0-master-client-3: ***** reading over non-SSL >126: option log-level TRACE >127: option latency-measurement off >[2018-07-31 10:41:38.336907] T [rpc-clnt.c:674:rpc_clnt_reply_init] 0-master-client-3: received rpc message (RPC XID: 0x4 Program: PORTMAP, ProgVers: 1, Proc: 1) from rpc-transport (master-client-3) >128: option count-fop-hits off >129: subvolumes master-md-cache >130: end-volume >[2018-07-31 10:41:38.336930] I [rpc-clnt.c:2087:rpc_clnt_reconfig] 0-master-client-3: changing port to 49155 (from 0) >131: >132: volume meta-autoload >[2018-07-31 10:41:38.336982] T [socket.c:861:__socket_disconnect] 0-master-client-3: disconnecting 0x7f36f0069940, sock=12 >133: type meta >134: subvolumes master >135: end-volume >136: >+------------------------------------------------------------------------------+ >[2018-07-31 10:41:38.337133] D [glusterfsd-mgmt.c:2796:glusterfs_mgmt_pmap_signin] 0-fsd-mgmt: portmapper signin arguments not given >[2018-07-31 10:41:38.337190] T [socket.c:3002:socket_event_handler] 0-glusterfs: (sock:9) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.337197] T [socket.c:865:__socket_disconnect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0x608e)[0x7f36f810d08e] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe02b)[0x7f36f811502b] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_disconnect+0x96)[0x7f370374a45b] (--> /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so(+0x54292)[0x7f36f5e0f292] ))))) 0-master-client-3: tearing down socket connection >[2018-07-31 10:41:38.337245] T [socket.c:3002:socket_event_handler] 0-master-client-3: (sock:12) socket_event_poll_in returned 0 >[2018-07-31 10:41:38.337264] T [socket.c:2960:socket_event_handler] 0-master-client-3: client (sock:12) in:1, out:0, err:16 >[2018-07-31 10:41:38.337284] T [socket.c:236:socket_dump_info] 0-master-client-3: $$$ client: disconnecting from (af:2,sock:12) 23.253.56.86 non-SSL (errno:0:Success) >[2018-07-31 10:41:38.337303] D [socket.c:3021:socket_event_handler] 0-transport: EPOLLERR - disconnecting (sock:12) (non-SSL) >[2018-07-31 10:41:38.337323] D [MSGID: 0] [client.c:2242:client_rpc_notify] 0-master-client-3: got RPC_CLNT_DISCONNECT >[2018-07-31 10:41:38.337341] D [MSGID: 0] [client.c:2284:client_rpc_notify] 0-master-client-3: disconnected (skipped notify) >[2018-07-31 10:41:38.337359] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-3: attempting reconnect >[2018-07-31 10:41:38.337378] T [socket.c:3409:socket_connect] 0-master-client-3: connecting 0x7f36f0069940, sock=-1 >[2018-07-31 10:41:38.337393] T [name.c:243:af_inet_client_get_remote_sockaddr] 0-master-client-3: option remote-port missing in volume master-client-3. Defaulting to 24007 >[2018-07-31 10:41:38.340345] D [MSGID: 0] [common-utils.c:339:gf_resolve_ip6] 0-resolver: returning ip-104.130.69.104 (port-24007) for hostname: builderhrk500.cloud.gluster.org and port: 24007 >[2018-07-31 10:41:38.340394] T [socket.c:961:__socket_nodelay] 0-master-client-3: NODELAY enabled for socket 10 >[2018-07-31 10:41:38.340416] T [socket.c:1049:__socket_keepalive] 0-master-client-3: Keep-alive enabled for socket: 10, (idle: 20, interval: 2, max-probes: 9, timeout: 0) >[2018-07-31 10:41:38.340493] T [socket.c:3541:socket_connect] 0-master-client-3: >>> connect() with non-blocking IO for ALL >[2018-07-31 10:41:38.340514] T [socket.c:236:socket_dump_info] 0-master-client-3: $$$ client: connecting to (af:2,sock:10) 104.130.69.104 non-SSL (errno:0:Success) >[2018-07-31 10:41:42.282482] T [rpc-clnt.c:419:rpc_clnt_reconnect] 0-glusterfs: breaking reconnect chain >[2018-07-31 10:41:42.282555] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-0: attempting reconnect >[2018-07-31 10:41:42.283808] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-0: connect () called on transport already connected >[2018-07-31 10:41:42.283910] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-1: attempting reconnect >[2018-07-31 10:41:42.284112] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-1: connect () called on transport already connected >[2018-07-31 10:41:42.284149] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-2: attempting reconnect >[2018-07-31 10:41:42.284362] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-2: connect () called on transport already connected >[2018-07-31 10:41:42.284389] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-3: attempting reconnect >[2018-07-31 10:41:42.284571] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-3: connect () called on transport already connected >[2018-07-31 10:41:45.285015] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-0: attempting reconnect >[2018-07-31 10:41:45.285442] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-0: connect () called on transport already connected >[2018-07-31 10:41:45.285488] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-1: attempting reconnect >[2018-07-31 10:41:45.285724] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-1: connect () called on transport already connected >[2018-07-31 10:41:45.285759] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-2: attempting reconnect >[2018-07-31 10:41:45.286041] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-2: connect () called on transport already connected >[2018-07-31 10:41:45.286078] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-3: attempting reconnect >[2018-07-31 10:41:45.286292] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-3: connect () called on transport already connected >[2018-07-31 10:41:48.286755] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-0: attempting reconnect >[2018-07-31 10:41:48.287239] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-0: connect () called on transport already connected >[2018-07-31 10:41:48.287271] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-1: attempting reconnect >[2018-07-31 10:41:48.287464] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-1: connect () called on transport already connected >[2018-07-31 10:41:48.287491] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-2: attempting reconnect >[2018-07-31 10:41:48.287671] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-2: connect () called on transport already connected >[2018-07-31 10:41:48.287712] T [rpc-clnt.c:404:rpc_clnt_reconnect] 0-master-client-3: attempting reconnect >[2018-07-31 10:41:48.287926] T [socket.c:3402:socket_connect] (--> /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x1ee)[0x7f3703988368] (--> /usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0xe459)[0x7f36f8115459] (--> /usr/local/lib/libgfrpc.so.0(rpc_transport_connect+0x93)[0x7f370374a32a] (--> /usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0x133)[0x7f370374d5c2] (--> /usr/local/lib/libglusterfs.so.0(+0x3a9c7)[0x7f37039989c7] ))))) 0-master-client-3: connect () called on transport already connected >[2018-07-31 10:41:49.288117] D [fuse-bridge.c:5407:notify] 0-fuse: got event 6 on graph 0 >[2018-07-31 10:41:49.289427] D [fuse-bridge.c:4990:fuse_get_mount_status] 0-fuse: mount status is 0 >[2018-07-31 10:41:49.289555] D [fuse-bridge.c:4256:fuse_init] 0-glusterfs-fuse: Detected support for FUSE_AUTO_INVAL_DATA. Enabling fopen_keep_cache automatically. >[2018-07-31 10:41:49.289591] T [fuse-bridge.c:278:send_fuse_iov] 0-glusterfs-fuse: writev() result 40/40 >[2018-07-31 10:41:49.289610] I [fuse-bridge.c:4314:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.24 kernel 7.22 >[2018-07-31 10:41:49.289627] I [fuse-bridge.c:4948:fuse_graph_sync] 0-fuse: switched to graph 0 >[2018-07-31 10:41:49.289696] T [MSGID: 0] [syncop.c:1261:syncop_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from fuse to meta-autoload >[2018-07-31 10:41:49.289743] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from meta-autoload to master >[2018-07-31 10:41:49.289787] T [MSGID: 0] [io-stats.c:2788:io_stats_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master to master-md-cache >[2018-07-31 10:41:49.289833] T [MSGID: 0] [md-cache.c:513:mdc_inode_iatt_get] 0-md-cache: mdc_inode_ctx_get failed (00000000-0000-0000-0000-000000000001) >[2018-07-31 10:41:49.289923] T [MSGID: 0] [md-cache.c:1200:mdc_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-md-cache to master-open-behind >[2018-07-31 10:41:49.289946] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-open-behind to master-quick-read >[2018-07-31 10:41:49.289973] T [MSGID: 0] [quick-read.c:556:qr_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-quick-read to master-io-cache >[2018-07-31 10:41:49.290002] T [MSGID: 0] [io-cache.c:298:ioc_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-io-cache to master-readdir-ahead >[2018-07-31 10:41:49.290034] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-readdir-ahead to master-read-ahead >[2018-07-31 10:41:49.290052] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-read-ahead to master-write-behind >[2018-07-31 10:41:49.290077] T [MSGID: 0] [write-behind.c:2439:wb_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-write-behind to master-dht >[2018-07-31 10:41:49.290156] D [MSGID: 0] [dht-common.c:3674:dht_do_fresh_lookup] 0-master-dht: /: no subvolume in layout for path, checking on all the subvols to see if it is a directory >[2018-07-31 10:41:49.290180] D [MSGID: 0] [dht-common.c:3688:dht_do_fresh_lookup] 0-master-dht: /: Found null hashed subvol. Calling lookup on all nodes. >[2018-07-31 10:41:49.290199] T [MSGID: 0] [dht-common.c:3695:dht_do_fresh_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-dht to master-replicate-0 >[2018-07-31 10:41:49.290245] I [MSGID: 108006] [afr-common.c:5582:afr_local_init] 0-master-replicate-0: no subvolumes up >[2018-07-31 10:41:49.290291] D [MSGID: 0] [afr-common.c:3212:afr_discover] 0-stack-trace: stack-address: 0x7f36e4001058, master-replicate-0 returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.290323] D [MSGID: 0] [dht-common.c:1391:dht_lookup_dir_cbk] 0-master-dht: lookup of / on master-replicate-0 returned error [Transport endpoint is not connected] >[2018-07-31 10:41:49.290350] T [MSGID: 0] [dht-common.c:3695:dht_do_fresh_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-dht to master-replicate-1 >[2018-07-31 10:41:49.290381] I [MSGID: 108006] [afr-common.c:5582:afr_local_init] 0-master-replicate-1: no subvolumes up >[2018-07-31 10:41:49.290403] D [MSGID: 0] [afr-common.c:3212:afr_discover] 0-stack-trace: stack-address: 0x7f36e4001058, master-replicate-1 returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.290427] D [MSGID: 0] [dht-common.c:1391:dht_lookup_dir_cbk] 0-master-dht: lookup of / on master-replicate-1 returned error [Transport endpoint is not connected] >[2018-07-31 10:41:49.290452] D [MSGID: 0] [dht-common.c:1574:dht_lookup_dir_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-dht returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.290477] D [MSGID: 0] [write-behind.c:2393:wb_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-write-behind returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.290504] D [MSGID: 0] [io-cache.c:268:ioc_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-io-cache returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.290530] D [MSGID: 0] [quick-read.c:515:qr_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-quick-read returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.290554] D [MSGID: 0] [md-cache.c:1130:mdc_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-md-cache returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.290581] D [MSGID: 0] [io-stats.c:2276:io_stats_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.290626] E [fuse-bridge.c:4382:fuse_first_lookup] 0-fuse: first lookup on root failed (Transport endpoint is not connected) >[2018-07-31 10:41:49.290763] T [MSGID: 0] [fuse-bridge.c:995:fuse_getattr] 0-stack-trace: stack-address: 0x7f36e4001058, winding from fuse to meta-autoload >[2018-07-31 10:41:49.290790] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from meta-autoload to master >[2018-07-31 10:41:49.290808] T [MSGID: 0] [io-stats.c:2788:io_stats_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master to master-md-cache >[2018-07-31 10:41:49.290831] T [MSGID: 0] [md-cache.c:513:mdc_inode_iatt_get] 0-md-cache: mdc_inode_ctx_get failed (00000000-0000-0000-0000-000000000001) >[2018-07-31 10:41:49.290874] T [MSGID: 0] [md-cache.c:1200:mdc_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-md-cache to master-open-behind >[2018-07-31 10:41:49.290894] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-open-behind to master-quick-read >[2018-07-31 10:41:49.290914] T [MSGID: 0] [quick-read.c:556:qr_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-quick-read to master-io-cache >[2018-07-31 10:41:49.290935] T [MSGID: 0] [io-cache.c:298:ioc_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-io-cache to master-readdir-ahead >[2018-07-31 10:41:49.290955] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-readdir-ahead to master-read-ahead >[2018-07-31 10:41:49.290971] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-read-ahead to master-write-behind >[2018-07-31 10:41:49.290989] T [MSGID: 0] [write-behind.c:2439:wb_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-write-behind to master-dht >[2018-07-31 10:41:49.291022] D [MSGID: 0] [dht-common.c:3674:dht_do_fresh_lookup] 0-master-dht: /: no subvolume in layout for path, checking on all the subvols to see if it is a directory >[2018-07-31 10:41:49.291046] D [MSGID: 0] [dht-common.c:3688:dht_do_fresh_lookup] 0-master-dht: /: Found null hashed subvol. Calling lookup on all nodes. >[2018-07-31 10:41:49.291069] T [MSGID: 0] [dht-common.c:3695:dht_do_fresh_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-dht to master-replicate-0 >[2018-07-31 10:41:49.291092] I [MSGID: 108006] [afr-common.c:5582:afr_local_init] 0-master-replicate-0: no subvolumes up >[2018-07-31 10:41:49.291115] D [MSGID: 0] [afr-common.c:3212:afr_discover] 0-stack-trace: stack-address: 0x7f36e4001058, master-replicate-0 returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.291140] D [MSGID: 0] [dht-common.c:1391:dht_lookup_dir_cbk] 0-master-dht: lookup of / on master-replicate-0 returned error [Transport endpoint is not connected] >[2018-07-31 10:41:49.291160] T [MSGID: 0] [dht-common.c:3695:dht_do_fresh_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-dht to master-replicate-1 >[2018-07-31 10:41:49.291181] I [MSGID: 108006] [afr-common.c:5582:afr_local_init] 0-master-replicate-1: no subvolumes up >[2018-07-31 10:41:49.291201] D [MSGID: 0] [afr-common.c:3212:afr_discover] 0-stack-trace: stack-address: 0x7f36e4001058, master-replicate-1 returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.291224] D [MSGID: 0] [dht-common.c:1391:dht_lookup_dir_cbk] 0-master-dht: lookup of / on master-replicate-1 returned error [Transport endpoint is not connected] >[2018-07-31 10:41:49.291244] D [MSGID: 0] [dht-common.c:1574:dht_lookup_dir_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-dht returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.291267] D [MSGID: 0] [write-behind.c:2393:wb_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-write-behind returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.291292] D [MSGID: 0] [io-cache.c:268:ioc_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-io-cache returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.291316] D [MSGID: 0] [quick-read.c:515:qr_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-quick-read returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.291338] D [MSGID: 0] [md-cache.c:1130:mdc_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-md-cache returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.291378] D [MSGID: 0] [io-stats.c:2276:io_stats_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.291406] W [fuse-bridge.c:899:fuse_attr_cbk] 0-glusterfs-fuse: 2: LOOKUP() / => -1 (Transport endpoint is not connected) >[2018-07-31 10:41:49.291430] T [fuse-bridge.c:278:send_fuse_iov] 0-glusterfs-fuse: writev() result 16/16 >[2018-07-31 10:41:49.294391] T [MSGID: 0] [fuse-bridge.c:995:fuse_getattr] 0-stack-trace: stack-address: 0x7f36e4001058, winding from fuse to meta-autoload >[2018-07-31 10:41:49.294421] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from meta-autoload to master >[2018-07-31 10:41:49.294439] T [MSGID: 0] [io-stats.c:2788:io_stats_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master to master-md-cache >[2018-07-31 10:41:49.294462] T [MSGID: 0] [md-cache.c:513:mdc_inode_iatt_get] 0-md-cache: mdc_inode_ctx_get failed (00000000-0000-0000-0000-000000000001) >[2018-07-31 10:41:49.294486] T [MSGID: 0] [md-cache.c:1200:mdc_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-md-cache to master-open-behind >[2018-07-31 10:41:49.294511] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-open-behind to master-quick-read >[2018-07-31 10:41:49.294532] T [MSGID: 0] [quick-read.c:556:qr_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-quick-read to master-io-cache >[2018-07-31 10:41:49.294553] T [MSGID: 0] [io-cache.c:298:ioc_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-io-cache to master-readdir-ahead >[2018-07-31 10:41:49.294572] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-readdir-ahead to master-read-ahead >[2018-07-31 10:41:49.294589] T [MSGID: 0] [defaults.c:2716:default_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-read-ahead to master-write-behind >[2018-07-31 10:41:49.294606] T [MSGID: 0] [write-behind.c:2439:wb_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-write-behind to master-dht >[2018-07-31 10:41:49.294639] D [MSGID: 0] [dht-common.c:3674:dht_do_fresh_lookup] 0-master-dht: /: no subvolume in layout for path, checking on all the subvols to see if it is a directory >[2018-07-31 10:41:49.294657] D [MSGID: 0] [dht-common.c:3688:dht_do_fresh_lookup] 0-master-dht: /: Found null hashed subvol. Calling lookup on all nodes. >[2018-07-31 10:41:49.294675] T [MSGID: 0] [dht-common.c:3695:dht_do_fresh_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-dht to master-replicate-0 >[2018-07-31 10:41:49.294697] I [MSGID: 108006] [afr-common.c:5582:afr_local_init] 0-master-replicate-0: no subvolumes up >[2018-07-31 10:41:49.294719] D [MSGID: 0] [afr-common.c:3212:afr_discover] 0-stack-trace: stack-address: 0x7f36e4001058, master-replicate-0 returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.294743] D [MSGID: 0] [dht-common.c:1391:dht_lookup_dir_cbk] 0-master-dht: lookup of / on master-replicate-0 returned error [Transport endpoint is not connected] >[2018-07-31 10:41:49.294763] T [MSGID: 0] [dht-common.c:3695:dht_do_fresh_lookup] 0-stack-trace: stack-address: 0x7f36e4001058, winding from master-dht to master-replicate-1 >[2018-07-31 10:41:49.294784] I [MSGID: 108006] [afr-common.c:5582:afr_local_init] 0-master-replicate-1: no subvolumes up >[2018-07-31 10:41:49.294805] D [MSGID: 0] [afr-common.c:3212:afr_discover] 0-stack-trace: stack-address: 0x7f36e4001058, master-replicate-1 returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.294827] D [MSGID: 0] [dht-common.c:1391:dht_lookup_dir_cbk] 0-master-dht: lookup of / on master-replicate-1 returned error [Transport endpoint is not connected] >[2018-07-31 10:41:49.294865] D [MSGID: 0] [dht-common.c:1574:dht_lookup_dir_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-dht returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.294890] D [MSGID: 0] [write-behind.c:2393:wb_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-write-behind returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.294915] D [MSGID: 0] [io-cache.c:268:ioc_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-io-cache returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.294939] D [MSGID: 0] [quick-read.c:515:qr_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-quick-read returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.294962] D [MSGID: 0] [md-cache.c:1130:mdc_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master-md-cache returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.294985] D [MSGID: 0] [io-stats.c:2276:io_stats_lookup_cbk] 0-stack-trace: stack-address: 0x7f36e4001058, master returned -1 error: Transport endpoint is not connected [Transport endpoint is not connected] >[2018-07-31 10:41:49.295012] W [fuse-bridge.c:899:fuse_attr_cbk] 0-glusterfs-fuse: 3: LOOKUP() / => -1 (Transport endpoint is not connected) >[2018-07-31 10:41:49.295037] T [fuse-bridge.c:278:send_fuse_iov] 0-glusterfs-fuse: writev() result 16/16 >[2018-07-31 10:41:49.300895] D [fuse-bridge.c:5108:fuse_thread_proc] 0-glusterfs-fuse: terminating upon getting ENODEV when reading /dev/fuse >[2018-07-31 10:41:49.300940] I [fuse-bridge.c:5220:fuse_thread_proc] 0-fuse: initating unmount of /mnt >[2018-07-31 10:41:49.301005] D [logging.c:1795:gf_log_flush_extra_msgs] 0-logging-infra: Log buffer size reduced. About to flush 5 extra log messages >[2018-07-31 10:41:49.301033] D [logging.c:1798:gf_log_flush_extra_msgs] 0-logging-infra: Just flushed 5 extra log messages >[2018-07-31 10:41:49.301094] W [glusterfsd.c:1514:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7e25) [0x7f37029dbe25] -->/usr/local/sbin/glusterfs(glusterfs_sigwaiter+0xe6) [0x40a80f] -->/usr/local/sbin/glusterfs(cleanup_and_exit+0x88) [0x408b4a] ) 0-: received signum (15), shutting down >[2018-07-31 10:41:49.301122] D [mgmt-pmap.c:79:rpc_clnt_mgmt_pmap_signout] 0-fsd-mgmt: portmapper signout arguments not given >[2018-07-31 10:41:49.301141] I [fuse-bridge.c:6002:fini] 0-fuse: Unmounting '/mnt'. >[2018-07-31 10:41:49.301159] I [fuse-bridge.c:6007:fini] 0-fuse: Closing fuse connection to '/mnt'.
<b>You cannot view the attachment while viewing its details because your browser does not support IFRAMEs. <a href="attachment.cgi?id=1472715">View the attachment on a separate page</a>.</b>
View Attachment As Raw
Actions:
View
Attachments on
bug 1611635
: 1472715