Attachment 1487288 Details for Bug 1628529 – clvmd output node 3

clvmd output node 3

clvmd.out.03 (text/plain), 46.15 KB, created by David Teigland on 2018-09-26 14:47:48 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: David Teigland

Created: 2018-09-26 14:47:48 UTC

Size: 46.15 KB

patch

obsolete

>CLVMD[1050e840]: Sep 26 03:26:09 CLVMD started
>CLVMD[1050e840]: Sep 26 03:26:10 Created DLM lockspace for CLVMD.
>CLVMD[1050e840]: Sep 26 03:26:10 DLM initialisation complete
>CLVMD[1050e840]: Sep 26 03:26:10 Our local node id is 3
>CLVMD[1050e840]: Sep 26 03:26:10 Connected to Corosync
>CLVMD[1050e840]: Sep 26 03:26:10 Cluster ready, doing some more initialisation
>CLVMD[1050e840]: Sep 26 03:26:10 (0x5610f9ec5930) Adding listener for fd 4. (Now 2 monitored fds.)
>CLVMD[1050e840]: Sep 26 03:26:10 Starting LVM thread
>CLVMD[1050e840]: Sep 26 03:26:10 (0x5610f8c90080) Main cluster socket fd 5 with local socket 4 (0x5610f9ec5930)
>CLVMD[10377700]: Sep 26 03:26:10 LVM thread function started
>WARNING: Locking disabled. Be careful! This could corrupt your metadata.
>CLVMD[10377700]: Sep 26 03:26:10 LVM thread ready for work.
>CLVMD[10377700]: Sep 26 03:26:10 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:10 clvmd ready for work
>CLVMD[1050e840]: Sep 26 03:26:10 Using timeout of 60 seconds
>CLVMD[1050e840]: Sep 26 03:26:10 confchg callback. 1 joined, 0 left, 3 members
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_QUERY (0x34) for clientid 0xb000000 XID 1 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', mode -1 (--)
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_VG (0x33) for clientid 0xb000000 XID 2 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:26:24 Invalidating cached metadata for VG cvg
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_VG (0x33) for clientid 0xb000000 XID 3 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:26:24 vg_commit notification for VG cvg
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_QUERY (0x34) for clientid 0xb000000 XID 4 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh', mode -1 (--)
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_LV (0x32) for clientid 0xb000000 XID 7 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh', cmd = 0x98 LCK_LV_DEACTIVATE (NULL|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:26:24 do_deactivate_lock, lock not already held
>CLVMD[10377700]: Sep 26 03:26:24 Command return is 0, critical_section is 0
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_VG (0x33) for clientid 0xb000000 XID 9 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:26:24 Invalidating cached metadata for VG cvg
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_VG (0x33) for clientid 0xb000000 XID 10 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:26:24 vg_commit notification for VG cvg
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 23
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=23, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command VG_BACKUP (0x2b) for clientid 0xb000000 XID 11 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 Triggering backup of VG metadata for cvg.
>  Error backing up metadata, can't find VG for group cvg
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_QUERY (0x34) for clientid 0xb000000 XID 12 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', mode -1 (--)
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_QUERY (0x34) for clientid 0xb000000 XID 13 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4aT2pDp2wFRg0gifpdoguPdHkge6BEVh', mode -1 (--)
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_QUERY (0x34) for clientid 0xb000000 XID 14 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW4q0elcbzbVPNf0lcnNI29ArZrWhTshqK', mode -1 (--)
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_QUERY (0x34) for clientid 0xb000000 XID 15 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWiw2lx9kTK4bWFSySSQbC88E4UdjGZYkM', mode -1 (--)
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_QUERY (0x34) for clientid 0xb000000 XID 16 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWd67kvfFzt0ncsX8HFmmYcZMAPgLGapJd', mode -1 (--)
>CLVMD[10377700]: Sep 26 03:26:24 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:24 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:26:24 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:24 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:24 process_remote_command LOCK_LV (0x32) for clientid 0xb000000 XID 17 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:24 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x99 LCK_LV_ACTIVATE (READ|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:26:25 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', flags=1, mode=1
>CLVMD[10377700]: Sep 26 03:26:25 lock_resource returning 0, lock_id=1
>CLVMD[10377700]: Sep 26 03:26:25 Command return is 0, critical_section is 0
>CLVMD[10377700]: Sep 26 03:26:25 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:25 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:25 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:25 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:26:25 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:25 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:25 process_remote_command SYNC_NAMES (0x2d) for clientid 0xb000000 XID 19 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:25 Syncing device names
>CLVMD[10377700]: Sep 26 03:26:25 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:25 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:25 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:53 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:26:53 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:26:53 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:26:53 process_remote_command SYNC_NAMES (0x2d) for clientid 0xa000000 XID 23 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:26:53 Syncing device names
>CLVMD[10377700]: Sep 26 03:26:53 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:26:53 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:26:53 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 1 for 0. len 29
>CLVMD[1050e840]: Sep 26 03:27:31 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=29, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:31 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:31 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 25 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:31 do_lock_vg: resource 'P_#global', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:31 Refreshing context
>CLVMD[10377700]: Sep 26 03:27:31 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:27:31 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:31 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:31 process_remote_command SYNC_NAMES (0x2d) for clientid 0xa000000 XID 27 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:31 Syncing device names
>CLVMD[10377700]: Sep 26 03:27:31 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:27:31 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:31 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:31 process_remote_command SYNC_NAMES (0x2d) for clientid 0xa000000 XID 30 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:31 Syncing device names
>CLVMD[10377700]: Sep 26 03:27:31 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 1 for 0. len 30
>CLVMD[1050e840]: Sep 26 03:27:31 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=30, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:31 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:31 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 32 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:31 do_lock_vg: resource 'P_#orphans', cmd = 0x1 LCK_VG (READ|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:31 Invalidating cached metadata for VG #orphans
>CLVMD[10377700]: Sep 26 03:27:31 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 1 for 0. len 30
>CLVMD[1050e840]: Sep 26 03:27:31 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=30, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:31 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:31 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 33 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:31 do_lock_vg: resource 'P_#orphans', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:31 Invalidating cached metadata for VG #orphans
>CLVMD[10377700]: Sep 26 03:27:31 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 1 for 0. len 30
>CLVMD[1050e840]: Sep 26 03:27:31 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=30, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:31 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:31 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 34 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:31 do_lock_vg: resource 'P_#orphans', cmd = 0x4 LCK_VG (WRITE|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:31 Invalidating cached metadata for VG #orphans
>CLVMD[10377700]: Sep 26 03:27:31 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 1 for 0. len 30
>CLVMD[1050e840]: Sep 26 03:27:31 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=30, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:31 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:31 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 35 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:31 do_lock_vg: resource 'P_#orphans', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:31 Invalidating cached metadata for VG #orphans
>CLVMD[10377700]: Sep 26 03:27:31 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 1 for 0. len 29
>CLVMD[1050e840]: Sep 26 03:27:31 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=29, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:31 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:31 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 36 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:31 do_lock_vg: resource 'P_#global', cmd = 0x6 LCK_VG (UNLOCK|VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:31 Refreshing context
>CLVMD[10377700]: Sep 26 03:27:31 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:31 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:44 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:27:44 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:44 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:44 process_remote_command LOCK_QUERY (0x34) for clientid 0xa000000 XID 38 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:44 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', mode 1 (CR)
>CLVMD[10377700]: Sep 26 03:27:44 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:44 3 got message from nodeid 2 for 1. len 21
>CLVMD[1050e840]: Sep 26 03:27:44 3 got message from nodeid 3 for 1. len 21
>CLVMD[1050e840]: Sep 26 03:27:44 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:27:44 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:44 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:44 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 39 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:44 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:44 Invalidating cached metadata for VG cvg
>CLVMD[10377700]: Sep 26 03:27:44 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:44 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:44 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 40 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:45 vg_commit notification for VG cvg
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command LOCK_QUERY (0x34) for clientid 0xa000000 XID 41 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', mode -1 (--)
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command LOCK_LV (0x32) for clientid 0xa000000 XID 42 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', cmd = 0x99 LCK_LV_ACTIVATE (READ|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:45 lock_resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', flags=1, mode=1
>CLVMD[10377700]: Sep 26 03:27:45 lock_resource returning 0, lock_id=2
>CLVMD[10377700]: Sep 26 03:27:45 Command return is 0, critical_section is 0
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command LOCK_QUERY (0x34) for clientid 0xa000000 XID 43 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', mode 1 (CR)
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 21
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 21
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 44 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:45 Invalidating cached metadata for VG cvg
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command LOCK_LV (0x32) for clientid 0xa000000 XID 45 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:27:45 Command return is 0, critical_section is 1
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command LOCK_VG (0x33) for clientid 0xa000000 XID 46 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1
>CLVMD[10377700]: Sep 26 03:27:45 vg_commit notification for VG cvg
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command LOCK_LV (0x32) for clientid 0xa000000 XID 47 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1
>CLVMD[10377700]: Sep 26 03:27:45 Command return is 0, critical_section is 0
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 23
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=23, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command VG_BACKUP (0x2b) for clientid 0xa000000 XID 48 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 Triggering backup of VG metadata for cvg.
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 23
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=23, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command VG_BACKUP (0x2b) for clientid 0xa000000 XID 49 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 Triggering backup of VG metadata for cvg.
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command SYNC_NAMES (0x2d) for clientid 0xa000000 XID 50 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 Syncing device names
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command SYNC_NAMES (0x2d) for clientid 0xa000000 XID 53 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 Syncing device names
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:27:45 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:27:45 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:27:45 process_remote_command SYNC_NAMES (0x2d) for clientid 0xd000000 XID 56 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:27:45 Syncing device names
>CLVMD[10377700]: Sep 26 03:27:45 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:27:45 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:00 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:28:00 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:00 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:00 process_remote_command SYNC_NAMES (0x2d) for clientid 0xa000000 XID 59 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:00 Syncing device names
>CLVMD[10377700]: Sep 26 03:28:00 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:00 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:00 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:00 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:28:00 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:00 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:00 process_remote_command LOCK_VG (0x33) for clientid 0xd000000 XID 62 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:00 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:28:00 Invalidating cached metadata for VG cvg
>CLVMD[10377700]: Sep 26 03:28:00 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:00 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:00 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:00 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:28:00 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:00 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:00 process_remote_command LOCK_LV (0x32) for clientid 0xd000000 XID 63 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:00 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x24 ( DMEVENTD_MONITOR|ORIGIN_ONLY ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:28:01 Command return is 0, critical_section is 1
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_VG (0x33) for clientid 0xd000000 XID 64 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1
>CLVMD[10377700]: Sep 26 03:28:01 vg_commit notification for VG cvg
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_LV (0x32) for clientid 0xd000000 XID 65 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x24 ( DMEVENTD_MONITOR|ORIGIN_ONLY ), critical_section = 1
>CLVMD[10377700]: Sep 26 03:28:01 Command return is 0, critical_section is 0
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 23
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=23, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command VG_BACKUP (0x2b) for clientid 0xd000000 XID 66 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 Triggering backup of VG metadata for cvg.
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_VG (0x33) for clientid 0xd000000 XID 67 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:28:01 Invalidating cached metadata for VG cvg
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_VG (0x33) for clientid 0xd000000 XID 68 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:28:01 vg_commit notification for VG cvg
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_QUERY (0x34) for clientid 0xd000000 XID 69 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_query: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', mode 1 (CR)
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 21
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 21
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_LV (0x32) for clientid 0xd000000 XID 70 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', cmd = 0x99 LCK_LV_ACTIVATE (READ|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:28:01 do_activate_lv, lock already held at 1
>CLVMD[10377700]: Sep 26 03:28:01 Command return is 0, critical_section is 0
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_LV (0x32) for clientid 0xd000000 XID 72 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en', cmd = 0x98 LCK_LV_DEACTIVATE (NULL|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:28:01 unlock_resource: iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGW0HSczL5ZobaSm4QbXzERa9p3tILKF2en lockid: 2
>CLVMD[10377700]: Sep 26 03:28:01 Command return is 0, critical_section is 0
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_VG (0x33) for clientid 0xd000000 XID 73 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_vg: resource 'P_cvg', cmd = 0x104 LCK_VG (WRITE|VG|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:28:01 Invalidating cached metadata for VG cvg
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_LV (0x32) for clientid 0xd000000 XID 74 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9c LCK_LV_SUSPEND (WRITE|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 0
>CLVMD[10377700]: Sep 26 03:28:01 Command return is 0, critical_section is 1
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 25
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=25, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_VG (0x33) for clientid 0xd000000 XID 75 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_vg: resource 'P_cvg', cmd = 0x124 LCK_VG (WRITE|VG|HOLD|CACHE), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1
>CLVMD[10377700]: Sep 26 03:28:01 vg_commit notification for VG cvg
>CLVMD[10377700]: Sep 26 03:28:01 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:01 3 got message from nodeid 1 for 0. len 84
>CLVMD[1050e840]: Sep 26 03:28:01 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=84, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:01 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:01 process_remote_command LOCK_LV (0x32) for clientid 0xd000000 XID 76 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:01 do_lock_lv: resource 'iLKoSiQC0Pbny8zPiAeB3HtswiXs1yGWcb6SeyS6N1IgiBbM5qxx8PSxTIIE1F59', cmd = 0x9e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK|CLUSTER_VG), flags = 0x4 ( DMEVENTD_MONITOR ), critical_section = 1
>CLVMD[10377700]: Sep 26 03:28:04 Command return is 0, critical_section is 0
>CLVMD[10377700]: Sep 26 03:28:04 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:04 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:04 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:04 3 got message from nodeid 1 for 0. len 23
>CLVMD[1050e840]: Sep 26 03:28:04 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=23, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:04 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:04 process_remote_command VG_BACKUP (0x2b) for clientid 0xd000000 XID 77 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:04 Triggering backup of VG metadata for cvg.
>CLVMD[10377700]: Sep 26 03:28:04 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:04 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:04 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:04 3 got message from nodeid 1 for 0. len 31
>CLVMD[1050e840]: Sep 26 03:28:04 (0x5610f8c90080) add_to_lvmqueue: cmd=0x5610f9ec5a70, msg=0x7ffc3adb934c, len=31, csid=0x7ffc3adb7cfc, xid=0
>CLVMD[10377700]: Sep 26 03:28:04 (0x5610f8c90080) process_work_item: remote
>CLVMD[10377700]: Sep 26 03:28:04 process_remote_command SYNC_NAMES (0x2d) for clientid 0xd000000 XID 78 on node UNKNOWN 1
>CLVMD[10377700]: Sep 26 03:28:04 Syncing device names
>CLVMD[10377700]: Sep 26 03:28:04 LVM thread waiting for work
>CLVMD[1050e840]: Sep 26 03:28:04 3 got message from nodeid 3 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:28:04 3 got message from nodeid 2 for 1. len 18
>CLVMD[1050e840]: Sep 26 03:29:08 confchg callback. 0 joined, 1 left, 2 members
>CLVMD[1050e840]: Sep 26 03:29:10 confchg callback. 0 joined, 1 left, 1 members

Actions: View

Attachments on bug 1628529: 1483035 | 1484952 | 1484953 | 1485256 | 1486443 | 1487280 | 1487285 | 1487286 | 1487287 | 1487288 | 1492603