Attachment 1480401 Details for Bug 1580024 – glusterd log

glusterd log

glusterd.log (text/plain), 16.88 KB, created by Alexis Solanas on 2018-09-02 22:39:48 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Alexis Solanas

Created: 2018-09-02 22:39:48 UTC

Size: 16.88 KB

patch

obsolete

>[2018-09-02 22:14:35.638263] I [MSGID: 106062] [glusterd-volume-ops.c:2625:glusterd_op_start_volume] 0-management: Global dict not present.
>[2018-09-02 22:14:35.638574] W [MSGID: 106603] [glusterd-utils.c:5615:find_compat_brick_in_vol] 0-management: cluster.max-bricks-per-process options isn't set. Continuing with no limit set for brick multiplexing.
>[2018-09-02 22:14:35.638688] I [glusterd-utils.c:5446:attach_brick] 0-management: add brick /var/lib/heketi/mounts/vg_5010d0805890e4e816974cdc078d00d9/brick_5226dc43f96b03f119f87e30d82a08fc/brick to existing process for /var/lib/heketi/mounts/vg_5010d0805890e4e816974cdc078d00d9/brick_840194e50899a3fddc6bffc139bb5ec4/brick
>[2018-09-02 22:14:35.714097] I [rpc-clnt.c:1060:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2018-09-02 22:14:35.714380] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped
>[2018-09-02 22:14:35.714429] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: nfs service is stopped
>[2018-09-02 22:14:35.716376] I [MSGID: 106568] [glusterd-proc-mgmt.c:87:glusterd_proc_stop] 0-management: Stopping glustershd daemon running in pid: 4007
>[2018-09-02 22:14:36.720788] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: glustershd service is stopped
>[2018-09-02 22:14:36.720910] I [MSGID: 106567] [glusterd-svc-mgmt.c:197:glusterd_svc_start] 0-management: Starting glustershd service
>[2018-09-02 22:14:37.732106] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped
>[2018-09-02 22:14:37.732185] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: bitd service is stopped
>[2018-09-02 22:14:37.732275] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped
>[2018-09-02 22:14:37.732305] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: scrub service is stopped
>[2018-09-02 22:14:37.744344] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol_7d596038f9459b6b830d9bbf32e36ca8 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2018-09-02 22:14:37.758523] E [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd85d6) [0x7f35c11d85d6] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol_7d596038f9459b6b830d9bbf32e36ca8 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2018-09-02 22:22:43.078386] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0x388f5) [0x7f35c11388f5] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh --volname=vol_7d596038f9459b6b830d9bbf32e36ca8 --last=no
>[2018-09-02 22:22:43.084751] E [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0x388f5) [0x7f35c11388f5] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd85d6) [0x7f35c11d85d6] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh --volname=vol_7d596038f9459b6b830d9bbf32e36ca8 --last=no
>[2018-09-02 22:22:43.136543] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped
>[2018-09-02 22:22:43.136585] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: nfs service is stopped
>[2018-09-02 22:22:43.138382] I [MSGID: 106568] [glusterd-proc-mgmt.c:87:glusterd_proc_stop] 0-management: Stopping glustershd daemon running in pid: 13938
>[2018-09-02 22:22:44.142525] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: glustershd service is stopped
>[2018-09-02 22:22:44.142658] I [MSGID: 106567] [glusterd-svc-mgmt.c:197:glusterd_svc_start] 0-management: Starting glustershd service
>[2018-09-02 22:22:44.146263] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped
>[2018-09-02 22:22:44.146327] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: bitd service is stopped
>[2018-09-02 22:22:44.146493] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped
>[2018-09-02 22:22:44.146538] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: scrub service is stopped
>[2018-09-02 22:22:44.146844] I [MSGID: 106144] [glusterd-pmap.c:379:pmap_registry_remove] 0-pmap: removing brick /var/lib/heketi/mounts/vg_5010d0805890e4e816974cdc078d00d9/brick_5226dc43f96b03f119f87e30d82a08fc/brick on port 49152
>[2018-09-02 22:22:44.642844] I [MSGID: 106495] [glusterd-handler.c:3136:__glusterd_handle_getwd] 0-glusterd: Received getwd req
>[2018-09-02 22:22:44.648747] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/delete/post/S57glusterfind-delete-post --volname=vol_7d596038f9459b6b830d9bbf32e36ca8
>[2018-09-02 22:22:59.088799] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0x388f5) [0x7f35c11388f5] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh --volname=vol_203eadac756a761e51c2c2b738bbdddb --last=no
>[2018-09-02 22:22:59.095979] E [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0x388f5) [0x7f35c11388f5] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd85d6) [0x7f35c11d85d6] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh --volname=vol_203eadac756a761e51c2c2b738bbdddb --last=no
>[2018-09-02 22:22:59.146081] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: nfs service is stopped
>[2018-09-02 22:22:59.147205] I [MSGID: 106568] [glusterd-proc-mgmt.c:87:glusterd_proc_stop] 0-management: Stopping glustershd daemon running in pid: 14173
>[2018-09-02 22:23:00.150662] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: glustershd service is stopped
>[2018-09-02 22:23:00.150740] I [MSGID: 106567] [glusterd-svc-mgmt.c:197:glusterd_svc_start] 0-management: Starting glustershd service
>[2018-09-02 22:23:00.154267] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped
>[2018-09-02 22:23:00.154302] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: bitd service is stopped
>[2018-09-02 22:23:00.154353] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped
>[2018-09-02 22:23:00.154368] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: scrub service is stopped
>[2018-09-02 22:23:00.154575] I [MSGID: 106144] [glusterd-pmap.c:379:pmap_registry_remove] 0-pmap: removing brick /var/lib/heketi/mounts/vg_e48a8d6ed7013e232c0fecce28594ba4/brick_b5c42c69ae37f5cecb60f313a48b434a/brick on port 49152
>[2018-09-02 22:23:00.689343] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/delete/post/S57glusterfind-delete-post --volname=vol_203eadac756a761e51c2c2b738bbdddb
>[2018-09-02 22:23:00.680723] I [MSGID: 106495] [glusterd-handler.c:3136:__glusterd_handle_getwd] 0-glusterd: Received getwd req
>[2018-09-02 22:23:29.016048] I [MSGID: 106062] [glusterd-volume-ops.c:2625:glusterd_op_start_volume] 0-management: Global dict not present.
>[2018-09-02 22:23:29.016159] W [MSGID: 106603] [glusterd-utils.c:5615:find_compat_brick_in_vol] 0-management: cluster.max-bricks-per-process options isn't set. Continuing with no limit set for brick multiplexing.
>[2018-09-02 22:23:29.016245] I [glusterd-utils.c:5446:attach_brick] 0-management: add brick /var/lib/heketi/mounts/vg_5010d0805890e4e816974cdc078d00d9/brick_1ec098f25db4f3dd29cee94e1a576434/brick to existing process for /var/lib/heketi/mounts/vg_5010d0805890e4e816974cdc078d00d9/brick_840194e50899a3fddc6bffc139bb5ec4/brick
>[2018-09-02 22:23:29.075272] I [rpc-clnt.c:1060:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>The message "I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped" repeated 2 times between [2018-09-02 22:22:43.136543] and [2018-09-02 22:23:29.075502]
>[2018-09-02 22:23:29.075517] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: nfs service is stopped
>[2018-09-02 22:23:29.077271] I [MSGID: 106568] [glusterd-proc-mgmt.c:87:glusterd_proc_stop] 0-management: Stopping glustershd daemon running in pid: 14251
>[2018-09-02 22:23:30.080698] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: glustershd service is stopped
>[2018-09-02 22:23:30.080852] I [MSGID: 106567] [glusterd-svc-mgmt.c:197:glusterd_svc_start] 0-management: Starting glustershd service
>[2018-09-02 22:23:31.084491] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped
>[2018-09-02 22:23:31.084564] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: bitd service is stopped
>[2018-09-02 22:23:31.084656] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped
>[2018-09-02 22:23:31.084674] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: scrub service is stopped
>[2018-09-02 22:23:31.103290] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol_80c0e8bf342bda3b708cf4a64ccb97d4 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2018-09-02 22:23:31.118885] E [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd85d6) [0x7f35c11d85d6] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol_80c0e8bf342bda3b708cf4a64ccb97d4 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2018-09-02 22:24:06.512346] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0x388f5) [0x7f35c11388f5] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh --volname=vol_80c0e8bf342bda3b708cf4a64ccb97d4 --last=no
>[2018-09-02 22:24:06.520109] E [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0x388f5) [0x7f35c11388f5] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd85d6) [0x7f35c11d85d6] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh --volname=vol_80c0e8bf342bda3b708cf4a64ccb97d4 --last=no
>[2018-09-02 22:24:06.674858] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped
>[2018-09-02 22:24:06.674943] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: nfs service is stopped
>[2018-09-02 22:24:06.676346] I [MSGID: 106568] [glusterd-proc-mgmt.c:87:glusterd_proc_stop] 0-management: Stopping glustershd daemon running in pid: 14401
>[2018-09-02 22:24:07.679730] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: glustershd service is stopped
>[2018-09-02 22:24:07.679832] I [MSGID: 106567] [glusterd-svc-mgmt.c:197:glusterd_svc_start] 0-management: Starting glustershd service
>[2018-09-02 22:24:07.683191] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped
>[2018-09-02 22:24:07.683232] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: bitd service is stopped
>[2018-09-02 22:24:07.683299] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped
>[2018-09-02 22:24:07.683330] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: scrub service is stopped
>[2018-09-02 22:24:07.683565] I [MSGID: 106144] [glusterd-pmap.c:379:pmap_registry_remove] 0-pmap: removing brick /var/lib/heketi/mounts/vg_5010d0805890e4e816974cdc078d00d9/brick_1ec098f25db4f3dd29cee94e1a576434/brick on port 49152
>[2018-09-02 22:24:08.164314] I [MSGID: 106495] [glusterd-handler.c:3136:__glusterd_handle_getwd] 0-glusterd: Received getwd req
>[2018-09-02 22:24:08.173355] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/delete/post/S57glusterfind-delete-post --volname=vol_80c0e8bf342bda3b708cf4a64ccb97d4
>[2018-09-02 22:24:41.589689] I [MSGID: 106062] [glusterd-volume-ops.c:2625:glusterd_op_start_volume] 0-management: Global dict not present.
>[2018-09-02 22:24:41.589799] W [MSGID: 106603] [glusterd-utils.c:5615:find_compat_brick_in_vol] 0-management: cluster.max-bricks-per-process options isn't set. Continuing with no limit set for brick multiplexing.
>[2018-09-02 22:24:41.589910] I [glusterd-utils.c:5446:attach_brick] 0-management: add brick /var/lib/heketi/mounts/vg_5010d0805890e4e816974cdc078d00d9/brick_089a8b91eac38fbedbe452ea9486955f/brick to existing process for /var/lib/heketi/mounts/vg_5010d0805890e4e816974cdc078d00d9/brick_840194e50899a3fddc6bffc139bb5ec4/brick
>[2018-09-02 22:24:41.645657] I [rpc-clnt.c:1060:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
>[2018-09-02 22:24:41.645905] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: nfs service is stopped
>[2018-09-02 22:24:41.647924] I [MSGID: 106568] [glusterd-proc-mgmt.c:87:glusterd_proc_stop] 0-management: Stopping glustershd daemon running in pid: 14479
>[2018-09-02 22:24:42.651667] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: glustershd service is stopped
>[2018-09-02 22:24:42.651768] I [MSGID: 106567] [glusterd-svc-mgmt.c:197:glusterd_svc_start] 0-management: Starting glustershd service
>[2018-09-02 22:24:43.656692] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped
>[2018-09-02 22:24:43.656739] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: bitd service is stopped
>[2018-09-02 22:24:43.656794] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped
>[2018-09-02 22:24:43.656811] I [MSGID: 106568] [glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: scrub service is stopped
>[2018-09-02 22:24:43.991086] I [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8675) [0x7f35c11d8675] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=vol_aa59c5e3c5bf8d1b4f060b21978a9da4 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2018-09-02 22:24:44.004400] E [run.c:190:runner_log] (-->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd8bba) [0x7f35c11d8bba] -->/usr/lib64/glusterfs/3.8.4/xlator/mgmt/glusterd.so(+0xd85d6) [0x7f35c11d85d6] -->/lib64/libglusterfs.so.0(runner_log+0x115) [0x7f35c61a9175] ) 0-management: Failed to execute script: /var/lib/glusterd/hooks/1/start/post/S30samba-start.sh --volname=vol_aa59c5e3c5bf8d1b4f060b21978a9da4 --first=no --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
>[2018-09-02 22:24:41.645890] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped

Actions: View

Attachments on bug 1580024: 1438867 | 1480400 | 1480401