Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 1487286 Details for
Bug 1628529
upconvert attempt after secondary mirror leg failure causes clvmd to hang and gfs to withdraw
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
clvmd output node 1
clvmd.out.01 (text/plain), 215.82 KB, created by
David Teigland
on 2018-09-26 14:46:29 UTC
(
hide
)
Description:
clvmd output node 1
Filename:
MIME Type:
Creator:
David Teigland
Created:
2018-09-26 14:46:29 UTC
Size:
215.82 KB
patch
obsolete
>CLVMD[20631740]: Sep 26 14:39:03 CLVMD started >CLVMD[20631740]: Sep 26 14:39:04 Created DLM lockspace for CLVMD. >CLVMD[20631740]: Sep 26 14:39:04 DLM initialisation complete >CLVMD[20631740]: Sep 26 14:39:04 Our local node id is 1 >CLVMD[20631740]: Sep 26 14:39:04 Connected to Corosync >CLVMD[20631740]: Sep 26 14:39:04 Cluster ready, doing some more initialisation >CLVMD[20631740]: Sep 26 14:39:04 (0x5653c21e39c0) Adding listener for fd 4. (Now 2 monitored fds.) >CLVMD[20631740]: Sep 26 14:39:04 Starting LVM thread >CLVMD[20631740]: Sep 26 14:39:04 (0x5653c0c03080) Main cluster socket fd 5 with local socket 4 (0x5653c21e39c0) >CLVMD[204fe700]: Sep 26 14:39:04 LVM thread function started >WARNING: Locking disabled. Be careful! This could corrupt your metadata. >CLVMD[204fe700]: Sep 26 14:39:05 LVM thread ready for work. >CLVMD[204fe700]: Sep 26 14:39:05 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:39:05 clvmd ready for work >CLVMD[20631740]: Sep 26 14:39:05 Using timeout of 60 seconds >CLVMD[20631740]: Sep 26 14:39:05 confchg callback. 1 joined, 0 left, 1 members >CLVMD[20631740]: Sep 26 14:39:47 confchg callback. 1 joined, 0 left, 2 members >CLVMD[20631740]: Sep 26 14:39:49 confchg callback. 1 joined, 0 left, 3 members >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Got new connection on fd 11 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Adding listener for fd 11. (Now 3 monitored fds.) >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Read on local socket 11, len = 25 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Creating pipe, [12, 13] >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Adding listener for fd 12. (Now 4 monitored fds.) >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Creating pre&post thread for pipe fd 12 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Created pre&post thread, state = 0 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 4 >CLVMD[204dc700]: Sep 26 14:40:02 lock_resource 'V_cvg', flags=0, mode=4 >CLVMD[204dc700]: Sep 26 14:40:02 lock_resource returning 0, lock_id=1 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) distribute command: XID = 0, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=0 >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:40:02 do_lock_vg: resource 'V_cvg', cmd = 0x4 LCK_VG (WRITE|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:02 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:40:02 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:02 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:02 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:02 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) distribute command: XID = 1, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:02 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4340, len=84, csid=(nil), xid=1 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e43a0, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:02 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', mode -1 (--) >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:02 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:02 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:40:02 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:02 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Read on local socket 11, len = 25 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:02 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:02 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:02 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) distribute command: XID = 2, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:02 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=2 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:40:02 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:02 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:02 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:02 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:02 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:40:02 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:02 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:02 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:02 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 25 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 3, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:03 vg_commit notification for VG cvg >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 4, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4340, len=84, csid=(nil), xid=4 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e43a0, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh', mode -1 (--) >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 5, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4340, len=84, csid=(nil), xid=5 >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_LV (0x32) msg=0x5653c21e3c10, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh', cmd = 0x9d LCK_LV_EXCLUSIVE (EXCL|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:03 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh', flags=1, mode=5 >CLVMD[204fe700]: Sep 26 14:40:03 lock_resource returning 0, lock_id=2 >CLVMD[204fe700]: Sep 26 14:40:03 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 31 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 6, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=6 >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e43a0, msglen =31 >CLVMD[204fe700]: Sep 26 14:40:03 Syncing device names >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 7, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4340, len=84, csid=(nil), xid=7 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_LV (0x32) msg=0x5653c21e43d0, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh', cmd = 0x98 LCK_LV_DEACTIVATE (NULL|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 unlock_resource: iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh lockid: 2 >CLVMD[204fe700]: Sep 26 14:40:03 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 31 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 8, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=8 >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e3c10, msglen =31 >CLVMD[204fe700]: Sep 26 14:40:03 Syncing device names >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 25 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 9, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=9 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:03 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 25 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 10, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=10 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:03 vg_commit notification for VG cvg >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 23 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 11, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21df5c0, len=23, csid=(nil), xid=11 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: VG_BACKUP (0x2b) msg=0x5653c21e3c40, msglen =23 >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 23 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 12, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3bd0, len=84, csid=(nil), xid=12 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e4340, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', mode -1 (--) >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 13, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3bd0, len=84, csid=(nil), xid=13 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e4340, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh', mode -1 (--) >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 14, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3bd0, len=84, csid=(nil), xid=14 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e4340, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4q0elcbzbVPNf0lcnNI29ArZrWhTshqK', mode -1 (--) >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 15, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3bd0, len=84, csid=(nil), xid=15 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e4340, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWiw2lx9kTK4bWFSySSQbC88E4UdjGZYkM', mode -1 (--) >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 16, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3bd0, len=84, csid=(nil), xid=16 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e4340, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWd67kvfFzt0ncsX8HFmmYcZMAPgLGapJd', mode -1 (--) >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 84 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:03 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 17, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:03 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3bd0, len=84, csid=(nil), xid=17 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: LOCK_LV (0x32) msg=0x5653c21e4340, msglen =84 >CLVMD[204fe700]: Sep 26 14:40:03 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x99 LCK_LV_ACTIVATE (READ|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 1 for 0. len 84 >CLVMD[204fe700]: Sep 26 14:40:03 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', flags=1, mode=1 >CLVMD[204fe700]: Sep 26 14:40:03 lock_resource returning 0, lock_id=2 >CLVMD[204fe700]: Sep 26 14:40:03 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:03 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Read on local socket 11, len = 31 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) distribute command: XID = 18, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=18 >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e4340, msglen =31 >CLVMD[204fe700]: Sep 26 14:40:03 Syncing device names >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:03 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:40:03 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:03 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:03 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Read on local socket 11, len = 31 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:04 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:04 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:04 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) distribute command: XID = 19, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:04 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e4370, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=19 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e4340, msglen =31 >CLVMD[204fe700]: Sep 26 14:40:04 Syncing device names >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:04 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:04 1 got message from nodeid 1 for 0. len 31 >CLVMD[20631740]: Sep 26 14:40:04 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:04 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Read on local socket 11, len = 25 >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 6 >CLVMD[204dc700]: Sep 26 14:40:04 unlock_resource: V_cvg lockid: 1 >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 13 >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) distribute command: XID = 20, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=20 >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =25 >CLVMD[204fe700]: Sep 26 14:40:04 do_lock_vg: resource 'V_cvg', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:04 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:40:04 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Read on pipe 12, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Read on local socket 11, len = 0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) EOF on local socket 11: inprogress=0 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Waiting for pre&post thread >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:04 (0x5653c21e3ef0) Pre&post thread finished >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Joined pre&post thread >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3fe0) Removing listener for fd 12 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) ret == 0, errno = 0. removing client >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) Removing listener for fd -1 >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) removeme set with 2 monitored fds remaining >CLVMD[20631740]: Sep 26 14:40:04 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=(nil), len=0, csid=(nil), xid=20 >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) process_work_item: free >CLVMD[204fe700]: Sep 26 14:40:04 (0x5653c21e3ef0) Client thread cleanup >CLVMD[204fe700]: Sep 26 14:40:04 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Got new connection on fd 10 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Adding listener for fd 10. (Now 3 monitored fds.) >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Creating pipe, [11, 12] >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Adding listener for fd 11. (Now 4 monitored fds.) >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Creating pre&post thread for pipe fd 11 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Created pre&post thread, state = 0 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread pipe fd 12 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 1 >CLVMD[204dc700]: Sep 26 14:40:32 lock_resource 'V_cvg', flags=0, mode=3 >CLVMD[204dc700]: Sep 26 14:40:32 lock_resource returning 0, lock_id=1 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) distribute command: XID = 21, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=21 >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =25 >CLVMD[204fe700]: Sep 26 14:40:32 do_lock_vg: resource 'V_cvg', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:32 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:40:32 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Read on local socket 10, len = 31 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) distribute command: XID = 22, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=22 >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e4340, msglen =31 >CLVMD[204fe700]: Sep 26 14:40:32 Syncing device names >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:40:32 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Read on local socket 10, len = 31 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:40:32 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:40:32 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:40:32 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) distribute command: XID = 23, flags=0x0 () >CLVMD[20631740]: Sep 26 14:40:32 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=23 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e4340, msglen =31 >CLVMD[204fe700]: Sep 26 14:40:32 Syncing device names >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:40:32 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:40:32 1 got message from nodeid 1 for 0. len 31 >CLVMD[20631740]: Sep 26 14:40:32 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:40:32 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 6 >CLVMD[204dc700]: Sep 26 14:40:32 unlock_resource: V_cvg lockid: 1 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) distribute command: XID = 24, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=24 >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =25 >CLVMD[204fe700]: Sep 26 14:40:32 do_lock_vg: resource 'V_cvg', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:40:32 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:40:32 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Read on local socket 10, len = 0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) EOF on local socket 10: inprogress=0 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Waiting for pre&post thread >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:40:32 (0x5653c21e3ef0) Pre&post thread finished >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Joined pre&post thread >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3fe0) Removing listener for fd 11 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) ret == 0, errno = 0. removing client >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) Removing listener for fd -1 >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) removeme set with 2 monitored fds remaining >CLVMD[20631740]: Sep 26 14:40:32 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=(nil), len=0, csid=(nil), xid=24 >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) process_work_item: free >CLVMD[204fe700]: Sep 26 14:40:32 (0x5653c21e3ef0) Client thread cleanup >CLVMD[204fe700]: Sep 26 14:40:32 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got new connection on fd 10 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Adding listener for fd 10. (Now 3 monitored fds.) >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 29 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 2, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Creating pipe, [11, 12] >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Adding listener for fd 11. (Now 4 monitored fds.) >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Creating pre&post thread for pipe fd 11 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Created pre&post thread, state = 0 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'P_#global' at 1 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource 'P_#global', flags=0, mode=3 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource returning 0, lock_id=1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 25, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:09 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=29, csid=(nil), xid=25 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =29 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'P_#global', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Refreshing context >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 1 for 0. len 29 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 1 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource 'V_cvg', flags=0, mode=3 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource returning 0, lock_id=5 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 26, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=26 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'V_cvg', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 31 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 27, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:09 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=27 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e4340, msglen =31 >CLVMD[204fe700]: Sep 26 14:41:09 Syncing device names >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 1 for 0. len 31 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 6 >CLVMD[204dc700]: Sep 26 14:41:09 unlock_resource: V_cvg lockid: 5 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 28, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=28 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'V_cvg', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 34 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_rhel_null-01' at 1 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource 'V_rhel_null-01', flags=0, mode=3 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource returning 0, lock_id=5 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 29, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=34, csid=(nil), xid=29 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =34 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'V_rhel_null-01', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Invalidating cached metadata for VG rhel_null-01 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 31 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 30, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:09 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=30 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e4340, msglen =31 >CLVMD[204fe700]: Sep 26 14:41:09 Syncing device names >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 1 for 0. len 31 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 34 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_rhel_null-01' at 6 >CLVMD[204dc700]: Sep 26 14:41:09 unlock_resource: V_rhel_null-01 lockid: 5 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 31, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=34, csid=(nil), xid=31 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =34 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'V_rhel_null-01', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Invalidating cached metadata for VG rhel_null-01 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 30 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'P_#orphans' at 1 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource 'P_#orphans', flags=0, mode=3 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource returning 0, lock_id=5 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 32, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:09 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=30, csid=(nil), xid=32 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =30 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'P_#orphans', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Invalidating cached metadata for VG #orphans >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 1 for 0. len 30 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 30 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'P_#orphans' at 6 >CLVMD[204dc700]: Sep 26 14:41:09 unlock_resource: P_#orphans lockid: 5 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 33, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:09 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=30, csid=(nil), xid=33 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =30 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'P_#orphans', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Invalidating cached metadata for VG #orphans >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 1 for 0. len 30 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 30 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'P_#orphans' at 4 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource 'P_#orphans', flags=0, mode=4 >CLVMD[204dc700]: Sep 26 14:41:09 lock_resource returning 0, lock_id=5 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 34, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:09 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=30, csid=(nil), xid=34 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =30 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'P_#orphans', cmd = 0x4 LCK_VG (WRITE|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Invalidating cached metadata for VG #orphans >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 1 for 0. len 30 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 30 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'P_#orphans' at 6 >CLVMD[204dc700]: Sep 26 14:41:09 unlock_resource: P_#orphans lockid: 5 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 35, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:09 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=30, csid=(nil), xid=35 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =30 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'P_#orphans', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Invalidating cached metadata for VG #orphans >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 1 for 0. len 30 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 29 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:09 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) doing PRE command LOCK_VG 'P_#global' at 6 >CLVMD[204dc700]: Sep 26 14:41:09 unlock_resource: P_#global lockid: 1 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) distribute command: XID = 36, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:09 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=29, csid=(nil), xid=36 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =29 >CLVMD[204fe700]: Sep 26 14:41:09 do_lock_vg: resource 'P_#global', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:09 Refreshing context >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 1 for 0. len 29 >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:09 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Read on local socket 10, len = 0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) EOF on local socket 10: inprogress=0 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Waiting for pre&post thread >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:09 (0x5653c21e3ef0) Pre&post thread finished >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Joined pre&post thread >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3fe0) Removing listener for fd 11 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) ret == 0, errno = 0. removing client >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) Removing listener for fd -1 >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) removeme set with 2 monitored fds remaining >CLVMD[20631740]: Sep 26 14:41:09 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=(nil), len=0, csid=(nil), xid=36 >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) process_work_item: free >CLVMD[204fe700]: Sep 26 14:41:09 (0x5653c21e3ef0) Client thread cleanup >CLVMD[204fe700]: Sep 26 14:41:09 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got new connection on fd 10 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Adding listener for fd 10. (Now 3 monitored fds.) >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Creating pipe, [11, 12] >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Adding listener for fd 11. (Now 4 monitored fds.) >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Creating pre&post thread for pipe fd 11 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Created pre&post thread, state = 0 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 4 >CLVMD[204dc700]: Sep 26 14:41:23 lock_resource 'V_cvg', flags=0, mode=4 >CLVMD[204dc700]: Sep 26 14:41:23 lock_resource returning 0, lock_id=1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 37, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=37 >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_vg: resource 'V_cvg', cmd = 0x4 LCK_VG (WRITE|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:23 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 84 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 38, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3c10, len=84, csid=(nil), xid=38 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e4370, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', mode 1 (CR) >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 3 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 21 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 3 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 21 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 3 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 39, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=39 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:23 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 40, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=40 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4340, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:23 vg_commit notification for VG cvg >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 84 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 41, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4370, len=84, csid=(nil), xid=41 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e43d0, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', mode -1 (--) >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 84 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 42, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4370, len=84, csid=(nil), xid=42 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_LV (0x32) msg=0x5653c21e3c10, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', cmd = 0x99 LCK_LV_ACTIVATE (READ|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', flags=1, mode=1 >CLVMD[204fe700]: Sep 26 14:41:23 lock_resource returning 0, lock_id=5 >CLVMD[204fe700]: Sep 26 14:41:23 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 84 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 43, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4370, len=84, csid=(nil), xid=43 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e3c10, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', mode 1 (CR) >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 3 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 21 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 3 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 21 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 3 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 44, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4340, len=25, csid=(nil), xid=44 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3ba0, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:23 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 84 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 pre_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ) >CLVMD[204dc700]: Sep 26 14:41:23 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', flags=5, mode=4 >CLVMD[204dc700]: Sep 26 14:41:23 lock_resource returning 0, lock_id=2 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 45, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3bd0, len=84, csid=(nil), xid=45 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_LV (0x32) msg=0x5653c21e4370, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 Command return is 0, critical_section is 1 >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 46, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e4340, len=25, csid=(nil), xid=46 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3ba0, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1 >CLVMD[204fe700]: Sep 26 14:41:23 vg_commit notification for VG cvg >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:23 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Read on local socket 10, len = 84 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:23 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:23 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) distribute command: XID = 47, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:23 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21e3bd0, len=84, csid=(nil), xid=47 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:23 (0x5653c21e3ef0) process_local_command: LOCK_LV (0x32) msg=0x5653c21e4370, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:23 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:23 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:23 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:24 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:24 post_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ) >CLVMD[204dc700]: Sep 26 14:41:24 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', flags=4, mode=1 >CLVMD[204dc700]: Sep 26 14:41:24 lock_resource returning 0, lock_id=2 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Read on local socket 10, len = 23 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) distribute command: XID = 48, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:24 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c30, msg=0x5653c21df5c0, len=23, csid=(nil), xid=48 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_local_command: VG_BACKUP (0x2b) msg=0x5653c21e3ba0, msglen =23 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 1 for 0. len 23 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Read on local socket 10, len = 23 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) distribute command: XID = 49, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:24 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21df5c0, len=23, csid=(nil), xid=49 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_local_command: VG_BACKUP (0x2b) msg=0x5653c21e3c10, msglen =23 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 1 for 0. len 23 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Read on local socket 10, len = 31 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) distribute command: XID = 50, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:24 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=50 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e3c10, msglen =31 >CLVMD[204fe700]: Sep 26 14:41:24 Syncing device names >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 1 for 0. len 31 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 6 >CLVMD[204dc700]: Sep 26 14:41:24 unlock_resource: V_cvg lockid: 1 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) distribute command: XID = 51, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=51 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:24 do_lock_vg: resource 'V_cvg', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:24 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 1 >CLVMD[204dc700]: Sep 26 14:41:24 lock_resource 'V_cvg', flags=0, mode=3 >CLVMD[204dc700]: Sep 26 14:41:24 lock_resource returning 0, lock_id=1 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) distribute command: XID = 52, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=52 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:24 do_lock_vg: resource 'V_cvg', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:24 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Got new connection on fd 13 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Adding listener for fd 13. (Now 5 monitored fds.) >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Read on local socket 10, len = 31 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) distribute command: XID = 53, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:24 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=53 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e3c10, msglen =31 >CLVMD[204fe700]: Sep 26 14:41:24 Syncing device names >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 1 for 0. len 31 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 6 >CLVMD[204dc700]: Sep 26 14:41:24 unlock_resource: V_cvg lockid: 1 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) distribute command: XID = 54, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=54 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:24 do_lock_vg: resource 'V_cvg', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:24 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:24 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Creating pipe, [14, 15] >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Adding listener for fd 14. (Now 6 monitored fds.) >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Creating pre&post thread for pipe fd 14 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Created pre&post thread, state = 0 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) doing PRE command LOCK_VG 'V_cvg' at 4 >CLVMD[204ba700]: Sep 26 14:41:24 lock_resource 'V_cvg', flags=0, mode=4 >CLVMD[204ba700]: Sep 26 14:41:24 lock_resource returning 0, lock_id=1 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) distribute command: XID = 55, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3c10, len=25, csid=(nil), xid=55 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c40, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:24 do_lock_vg: resource 'V_cvg', cmd = 0x4 LCK_VG (WRITE|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:24 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) Got 1 replies, expecting: 1 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Read on local socket 13, len = 31 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:24 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) distribute command: XID = 56, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:24 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3c10, len=31, csid=(nil), xid=56 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e4790, msglen =31 >CLVMD[204fe700]: Sep 26 14:41:24 Syncing device names >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 1 for 0. len 31 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:24 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) doing PRE command LOCK_VG 'V_cvg' at 6 >CLVMD[204ba700]: Sep 26 14:41:24 unlock_resource: V_cvg lockid: 1 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) distribute command: XID = 57, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3c10, len=25, csid=(nil), xid=57 >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4790, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:24 do_lock_vg: resource 'V_cvg', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:24 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:24 (0x5653c21e4340) Got 1 replies, expecting: 1 >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:24 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:24 (0x5653c21e4340) Send local reply >CLVMD[204fe700]: Sep 26 14:41:24 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 1 >CLVMD[204dc700]: Sep 26 14:41:39 lock_resource 'V_cvg', flags=0, mode=3 >CLVMD[204dc700]: Sep 26 14:41:39 lock_resource returning 0, lock_id=1 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) distribute command: XID = 58, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=58 >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4790, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:39 do_lock_vg: resource 'V_cvg', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:39 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Read on local socket 10, len = 31 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 2, state = 1 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) distribute command: XID = 59, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:39 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e3ba0, len=31, csid=(nil), xid=59 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e4790, msglen =31 >CLVMD[204fe700]: Sep 26 14:41:39 Syncing device names >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 1 for 0. len 31 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Got 3 replies, expecting: 3 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Read on local socket 10, len = 25 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) doing PRE command LOCK_VG 'V_cvg' at 6 >CLVMD[204dc700]: Sep 26 14:41:39 unlock_resource: V_cvg lockid: 1 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread writes status 0 down to pipe fd 12 >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) distribute command: XID = 60, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3ba0, len=25, csid=(nil), xid=60 >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4790, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:39 do_lock_vg: resource 'V_cvg', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:39 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e3ef0) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread got post command condition... >CLVMD[204dc700]: Sep 26 14:41:39 (0x5653c21e3ef0) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Read on pipe 11, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3fe0) Background routine status was 0, sock_client 0x5653c21e3ef0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e3ef0) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) doing PRE command LOCK_VG 'V_cvg' at 4 >CLVMD[204ba700]: Sep 26 14:41:39 lock_resource 'V_cvg', flags=0, mode=4 >CLVMD[204ba700]: Sep 26 14:41:39 lock_resource returning 0, lock_id=1 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) distribute command: XID = 61, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3c10, len=25, csid=(nil), xid=61 >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4790, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:39 do_lock_vg: resource 'V_cvg', cmd = 0x4 LCK_VG (WRITE|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:39 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) distribute command: XID = 62, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:39 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3c10, len=25, csid=(nil), xid=62 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4790, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:39 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:39 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Read on local socket 13, len = 84 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:39 pre_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x24 ( DMEVENTD_MONITOR|ORIGIN_ONLY ) >CLVMD[204ba700]: Sep 26 14:41:39 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', flags=5, mode=4 >CLVMD[204ba700]: Sep 26 14:41:39 lock_resource returning 0, lock_id=2 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) distribute command: XID = 63, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:39 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e47c0, len=84, csid=(nil), xid=63 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_local_command: LOCK_LV (0x32) msg=0x5653c21e4820, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:39 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x24 ( DMEVENTD_MONITOR|ORIGIN_ONLY ), critical_section = 0 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:39 Command return is 0, critical_section is 1 >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) distribute command: XID = 64, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:39 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e3c10, len=25, csid=(nil), xid=64 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e4790, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:39 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1 >CLVMD[204fe700]: Sep 26 14:41:39 vg_commit notification for VG cvg >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Read on local socket 13, len = 84 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) distribute command: XID = 65, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:39 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e47c0, len=84, csid=(nil), xid=65 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_local_command: LOCK_LV (0x32) msg=0x5653c21e4820, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:39 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x24 ( DMEVENTD_MONITOR|ORIGIN_ONLY ), critical_section = 1 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 2 for 1. len 18 >CLVMD[204fe700]: Sep 26 14:41:39 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:39 post_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x24 ( DMEVENTD_MONITOR|ORIGIN_ONLY ) >CLVMD[204ba700]: Sep 26 14:41:39 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', flags=4, mode=1 >CLVMD[204ba700]: Sep 26 14:41:39 lock_resource returning 0, lock_id=2 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Read on local socket 13, len = 23 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) distribute command: XID = 66, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:39 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21df5c0, len=23, csid=(nil), xid=66 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_local_command: VG_BACKUP (0x2b) msg=0x5653c21e4790, msglen =23 >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 1 for 0. len 23 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:39 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) distribute command: XID = 67, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:39 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4790, len=25, csid=(nil), xid=67 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:39 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:39 Invalidating cached metadata for VG cvg >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 1 for 0. len 25 >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:39 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:39 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:39 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:39 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:39 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 68, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:40 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e4790, len=25, csid=(nil), xid=68 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:40 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:40 vg_commit notification for VG cvg >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 84 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 69, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:40 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e47c0, len=84, csid=(nil), xid=69 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: LOCK_QUERY (0x34) msg=0x5653c21e4820, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:40 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', mode 1 (CR) >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 1: 3 bytes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 2 for 1. len 21 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 2: 3 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 3 for 1. len 21 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 3: 3 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 84 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 70, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:40 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e47c0, len=84, csid=(nil), xid=70 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: LOCK_LV (0x32) msg=0x5653c21e3c10, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:40 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', cmd = 0x99 LCK_LV_ACTIVATE (READ|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:40 do_activate_lv, lock already held at 1 >CLVMD[204fe700]: Sep 26 14:41:40 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 31 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 71, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4790, len=31, csid=(nil), xid=71 >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e3c10, msglen =31 >CLVMD[204fe700]: Sep 26 14:41:40 Syncing device names >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:40 LVM thread waiting for work >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 84 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 72, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:40 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e47c0, len=84, csid=(nil), xid=72 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: LOCK_LV (0x32) msg=0x5653c21e4820, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:40 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', cmd = 0x98 LCK_LV_DEACTIVATE (NULL|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 unlock_resource: iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en lockid: 5 >CLVMD[204fe700]: Sep 26 14:41:40 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 73, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:40 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4790, len=25, csid=(nil), xid=73 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:40 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:40 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 84 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 pre_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ) >CLVMD[204ba700]: Sep 26 14:41:40 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', flags=5, mode=4 >CLVMD[204ba700]: Sep 26 14:41:40 lock_resource returning 0, lock_id=2 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 74, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:40 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e47c0, len=84, csid=(nil), xid=74 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: LOCK_LV (0x32) msg=0x5653c21e4820, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:40 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 Command return is 0, critical_section is 1 >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 75, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:40 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4790, len=25, csid=(nil), xid=75 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:40 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1 >CLVMD[204fe700]: Sep 26 14:41:40 vg_commit notification for VG cvg >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:40 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 1 for 0. len 25 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Read on local socket 13, len = 84 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:40 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:40 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) distribute command: XID = 76, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:40 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e47c0, len=84, csid=(nil), xid=76 >CLVMD[20631740]: Sep 26 14:41:40 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:40 (0x5653c21e4340) process_local_command: LOCK_LV (0x32) msg=0x5653c21e4820, msglen =84 >CLVMD[204fe700]: Sep 26 14:41:40 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1 >CLVMD[20631740]: Sep 26 14:41:40 1 got message from nodeid 1 for 0. len 84 >CLVMD[20631740]: Sep 26 14:41:43 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:43 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:43 Command return is 0, critical_section is 0 >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:43 LVM thread waiting for work >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:43 post_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ) >CLVMD[204ba700]: Sep 26 14:41:43 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', flags=4, mode=1 >CLVMD[204ba700]: Sep 26 14:41:43 lock_resource returning 0, lock_id=2 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Read on local socket 13, len = 23 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:43 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:43 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:43 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) distribute command: XID = 77, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:43 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21df5c0, len=23, csid=(nil), xid=77 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) process_local_command: VG_BACKUP (0x2b) msg=0x5653c21e3c10, msglen =23 >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:43 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:43 1 got message from nodeid 1 for 0. len 23 >CLVMD[20631740]: Sep 26 14:41:43 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:43 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Read on local socket 13, len = 31 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) check_all_clvmds_running >CLVMD[20631740]: Sep 26 14:41:43 down_callback. node 3, state = 1 >CLVMD[20631740]: Sep 26 14:41:43 down_callback. node 1, state = 1 >CLVMD[20631740]: Sep 26 14:41:43 down_callback. node 2, state = 1 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) distribute command: XID = 78, flags=0x0 () >CLVMD[20631740]: Sep 26 14:41:43 num_nodes = 3 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3bd0, msg=0x5653c21e4790, len=31, csid=(nil), xid=78 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Sending message to all cluster nodes >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) process_local_command: SYNC_NAMES (0x2d) msg=0x5653c21e3c10, msglen =31 >CLVMD[204fe700]: Sep 26 14:41:43 Syncing device names >CLVMD[20631740]: Sep 26 14:41:43 1 got message from nodeid 1 for 0. len 31 >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Got 1 replies, expecting: 3 >CLVMD[204fe700]: Sep 26 14:41:43 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:43 1 got message from nodeid 3 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 3: 0 bytes >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Got 2 replies, expecting: 3 >CLVMD[20631740]: Sep 26 14:41:43 1 got message from nodeid 2 for 1. len 18 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 2: 0 bytes >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Got 3 replies, expecting: 3 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Read on local socket 13, len = 25 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) doing PRE command LOCK_VG 'V_cvg' at 6 >CLVMD[204ba700]: Sep 26 14:41:43 unlock_resource: V_cvg lockid: 1 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread writes status 0 down to pipe fd 15 >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread waiting to do post command, state = 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) distribute command: XID = 79, flags=0x1 (LOCAL) >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Doing command explicitly on local node only >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=0x5653c21e4790, len=25, csid=(nil), xid=79 >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) process_work_item: local >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) process_local_command: LOCK_VG (0x33) msg=0x5653c21e3c10, msglen =25 >CLVMD[204fe700]: Sep 26 14:41:43 do_lock_vg: resource 'V_cvg', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0 >CLVMD[204fe700]: Sep 26 14:41:43 Invalidating cached metadata for VG cvg >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Reply from node 1: 0 bytes >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Got 1 replies, expecting: 1 >CLVMD[204fe700]: Sep 26 14:41:43 LVM thread waiting for work >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread got post command condition... >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread waiting for next pre command >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Read on pipe 14, 4 bytes, status 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Background routine status was 0, sock_client 0x5653c21e4340 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Send local reply >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Read on local socket 13, len = 0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) EOF on local socket 13: inprogress=0 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Waiting for pre&post thread >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread got pre command condition... >CLVMD[204ba700]: Sep 26 14:41:43 (0x5653c21e4340) Pre&post thread finished >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Joined pre&post thread >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4430) Removing listener for fd 14 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) ret == 0, errno = 0. removing client >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) Removing listener for fd -1 >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) removeme set with 4 monitored fds remaining >CLVMD[20631740]: Sep 26 14:41:43 (0x5653c21e4340) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=(nil), len=0, csid=(nil), xid=79 >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) process_work_item: free >CLVMD[204fe700]: Sep 26 14:41:43 (0x5653c21e4340) Client thread cleanup >CLVMD[204fe700]: Sep 26 14:41:43 LVM thread waiting for work >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3ef0) Read on local socket 10, len = 0 >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3ef0) EOF on local socket 10: inprogress=0 >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3ef0) Waiting for pre&post thread >CLVMD[204dc700]: Sep 26 14:41:54 (0x5653c21e3ef0) Pre&post thread got pre command condition... >CLVMD[204dc700]: Sep 26 14:41:54 (0x5653c21e3ef0) Pre&post thread finished >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3ef0) Joined pre&post thread >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3fe0) Removing listener for fd 11 >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3ef0) ret == 0, errno = 0. removing client >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3ef0) Removing listener for fd -1 >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3ef0) removeme set with 2 monitored fds remaining >CLVMD[20631740]: Sep 26 14:41:54 (0x5653c21e3ef0) add_to_lvmqueue: cmd=0x5653c21e3c40, msg=(nil), len=0, csid=(nil), xid=60 >CLVMD[204fe700]: Sep 26 14:41:54 (0x5653c21e3ef0) process_work_item: free >CLVMD[204fe700]: Sep 26 14:41:54 (0x5653c21e3ef0) Client thread cleanup >CLVMD[204fe700]: Sep 26 14:41:54 LVM thread waiting for work
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1628529
:
1483035
|
1484952
|
1484953
|
1485256
|
1486443
|
1487280
|
1487285
| 1487286 |
1487287
|
1487288
|
1492603