Attachment 415521 Details for Bug 594511 – dlm_tool dump

dlm_tool dump

dlm.txt (text/plain), 17.01 KB, created by David Teigland on 2010-05-20 21:33:26 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: David Teigland

Created: 2010-05-20 21:33:26 UTC

Size: 17.01 KB

patch

obsolete

>1274304342 logging mode 3 syslog f 160 p 6 logfile p 6 /var/log/cluster/dlm_controld.log
>1274304342 dlm_controld 3.0.12 started
>1274304343 logging mode 3 syslog f 160 p 6 logfile p 6 /var/log/cluster/dlm_controld.log
>1274304343 found /dev/misc/dlm-control minor 56
>1274304343 found /dev/misc/dlm-monitor minor 55
>1274304343 found /dev/misc/dlm_plock minor 54
>1274304343 /dev/misc/dlm-monitor fd 12
>1274304343 /sys/kernel/config/dlm/cluster/comms: opendir failed: 2
>1274304343 /sys/kernel/config/dlm/cluster/spaces: opendir failed: 2
>1274304343 cluster node 1 added
>1274304343 set_configfs_node 1 10.15.89.61 local 1
>1274304343 cluster node 3 added
>1274304343 set_configfs_node 3 10.15.89.63 local 0
>1274304343 cluster node 4 added
>1274304343 set_configfs_node 4 10.15.89.64 local 0
>1274304343 totem/rrp_mode = 'none'
>1274304343 set protocol 0
>1274304343 group_mode 3 compat 0
>1274304343 setup_cpg_daemon 14
>1274304343 dlm:controld conf 3 1 0 memb 1 3 4 join 1 left
>1274304343 run protocol from nodeid 3
>1274304343 daemon run 1.1.1 max 1.1.1 kernel run 1.1.1 max 1.1.1
>1274304343 plocks 16
>1274304343 plock cpg message size: 104 bytes
>1274304343 client connection 5 fd 17
>1274304347 uevent: add@/kernel/dlm/clvmd
>1274304347 kernel: add@ clvmd
>1274304347 uevent: online@/kernel/dlm/clvmd
>1274304347 kernel: online@ clvmd
>1274304347 dlm:ls:clvmd conf 3 1 0 memb 1 3 4 join 1 left
>1274304347 clvmd add_change cg 1 joined nodeid 1
>1274304347 clvmd add_change cg 1 we joined
>1274304347 clvmd add_change cg 1 counts member 3 joined 1 remove 0 failed 0
>1274304347 clvmd check_fencing done
>1274304347 clvmd check_quorum disabled
>1274304347 clvmd check_fs none registered
>1274304347 clvmd send_start cg 1 flags 1 data2 0 counts 0 3 1 0 0
>1274304347 clvmd receive_start 1:1 len 84
>1274304347 clvmd match_change 1:1 matches cg 1
>1274304347 clvmd wait_messages cg 1 need 2 of 3
>1274304347 clvmd receive_start 3:9 len 84
>1274304347 clvmd match_change 3:9 matches cg 1
>1274304347 clvmd wait_messages cg 1 need 1 of 3
>1274304347 clvmd receive_start 4:2 len 84
>1274304347 clvmd match_change 4:2 matches cg 1
>1274304347 clvmd wait_messages cg 1 got all 3
>1274304347 clvmd start_kernel cg 1 member_count 3
>1274304347 write "1090842362" to "/sys/kernel/dlm/clvmd/id"
>1274304347 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/clvmd/nodes/1"
>1274304347 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/clvmd/nodes/3"
>1274304347 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/clvmd/nodes/4"
>1274304347 write "1" to "/sys/kernel/dlm/clvmd/control"
>1274304347 write "0" to "/sys/kernel/dlm/clvmd/event_done"
>1274304347 clvmd set_plock_ckpt_node from 0 to 3
>1274304347 clvmd receive_plocks_stored 3:9 flags a sig 0 need_plocks 1
>1274304347 clvmd match_change 3:9 matches cg 1
>1274304347 clvmd retrieve_plocks
>1274304347 clvmd retrieve_plocks first 0 last 0 r_count 0 p_count 0 sig 0
>1274304347 uevent: add@/devices/virtual/misc/dlm_clvmd
>1274304363 uevent: add@/kernel/dlm/morph-cluster1
>1274304363 kernel: add@ morph-cluster1
>1274304363 uevent: online@/kernel/dlm/morph-cluster1
>1274304363 kernel: online@ morph-cluster1
>1274304363 dlm:ls:morph-cluster1 conf 3 1 0 memb 1 3 4 join 1 left
>1274304363 morph-cluster1 add_change cg 1 joined nodeid 1
>1274304363 morph-cluster1 add_change cg 1 we joined
>1274304363 morph-cluster1 add_change cg 1 counts member 3 joined 1 remove 0 failed 0
>1274304363 morph-cluster1 check_fencing done
>1274304363 morph-cluster1 check_quorum disabled
>1274304363 morph-cluster1 check_fs done
>1274304363 morph-cluster1 send_start cg 1 flags 1 data2 0 counts 0 3 1 0 0
>1274304363 morph-cluster1 receive_start 1:1 len 84
>1274304363 morph-cluster1 match_change 1:1 matches cg 1
>1274304363 morph-cluster1 wait_messages cg 1 need 2 of 3
>1274304363 morph-cluster1 receive_start 3:9 len 84
>1274304363 morph-cluster1 match_change 3:9 matches cg 1
>1274304363 morph-cluster1 wait_messages cg 1 need 1 of 3
>1274304363 morph-cluster1 receive_start 4:2 len 84
>1274304363 morph-cluster1 match_change 4:2 matches cg 1
>1274304363 morph-cluster1 wait_messages cg 1 got all 3
>1274304363 morph-cluster1 start_kernel cg 1 member_count 3
>1274304363 write "1890272362" to "/sys/kernel/dlm/morph-cluster1/id"
>1274304363 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster1/nodes/1"
>1274304363 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster1/nodes/3"
>1274304363 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster1/nodes/4"
>1274304363 write "1" to "/sys/kernel/dlm/morph-cluster1/control"
>1274304363 write "0" to "/sys/kernel/dlm/morph-cluster1/event_done"
>1274304363 morph-cluster1 set_plock_ckpt_node from 0 to 3
>1274304363 morph-cluster1 receive_plocks_stored 3:9 flags a sig 0 need_plocks 1
>1274304363 morph-cluster1 match_change 3:9 matches cg 1
>1274304363 morph-cluster1 retrieve_plocks
>1274304363 morph-cluster1 retrieve_plocks first 0 last 0 r_count 0 p_count 0 sig 0
>1274304363 uevent: add@/kernel/dlm/morph-cluster2
>1274304363 kernel: add@ morph-cluster2
>1274304363 uevent: online@/kernel/dlm/morph-cluster2
>1274304363 kernel: online@ morph-cluster2
>1274304363 dlm:ls:morph-cluster2 conf 3 1 0 memb 1 3 4 join 1 left
>1274304363 morph-cluster2 add_change cg 1 joined nodeid 1
>1274304363 morph-cluster2 add_change cg 1 we joined
>1274304363 morph-cluster2 add_change cg 1 counts member 3 joined 1 remove 0 failed 0
>1274304363 morph-cluster2 check_fencing done
>1274304363 morph-cluster2 check_quorum disabled
>1274304363 morph-cluster2 check_fs done
>1274304363 morph-cluster2 send_start cg 1 flags 1 data2 0 counts 0 3 1 0 0
>1274304363 morph-cluster2 receive_start 1:1 len 84
>1274304363 morph-cluster2 match_change 1:1 matches cg 1
>1274304363 morph-cluster2 wait_messages cg 1 need 2 of 3
>1274304363 morph-cluster2 receive_start 3:9 len 84
>1274304363 morph-cluster2 match_change 3:9 matches cg 1
>1274304363 morph-cluster2 wait_messages cg 1 need 1 of 3
>1274304363 morph-cluster2 receive_start 4:2 len 84
>1274304363 morph-cluster2 match_change 4:2 matches cg 1
>1274304363 morph-cluster2 wait_messages cg 1 got all 3
>1274304363 morph-cluster2 start_kernel cg 1 member_count 3
>1274304363 write "1535514537" to "/sys/kernel/dlm/morph-cluster2/id"
>1274304363 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster2/nodes/1"
>1274304363 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster2/nodes/3"
>1274304364 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster2/nodes/4"
>1274304364 write "1" to "/sys/kernel/dlm/morph-cluster2/control"
>1274304364 write "0" to "/sys/kernel/dlm/morph-cluster2/event_done"
>1274304364 morph-cluster2 set_plock_ckpt_node from 0 to 3
>1274304364 morph-cluster2 receive_plocks_stored 3:9 flags a sig 0 need_plocks 1
>1274304364 morph-cluster2 match_change 3:9 matches cg 1
>1274304364 morph-cluster2 retrieve_plocks
>1274304364 morph-cluster2 retrieve_plocks first 0 last 0 r_count 0 p_count 0 sig 0
>1274304364 uevent: add@/kernel/dlm/morph-cluster0
>1274304364 kernel: add@ morph-cluster0
>1274304364 uevent: online@/kernel/dlm/morph-cluster0
>1274304364 kernel: online@ morph-cluster0
>1274304364 dlm:ls:morph-cluster0 conf 3 1 0 memb 1 3 4 join 1 left
>1274304364 morph-cluster0 add_change cg 1 joined nodeid 1
>1274304364 morph-cluster0 add_change cg 1 we joined
>1274304364 morph-cluster0 add_change cg 1 counts member 3 joined 1 remove 0 failed 0
>1274304364 morph-cluster0 check_fencing done
>1274304364 morph-cluster0 check_quorum disabled
>1274304364 morph-cluster0 check_fs done
>1274304364 morph-cluster0 send_start cg 1 flags 1 data2 0 counts 0 3 1 0 0
>1274304364 morph-cluster0 receive_start 1:1 len 84
>1274304364 morph-cluster0 match_change 1:1 matches cg 1
>1274304364 morph-cluster0 wait_messages cg 1 need 2 of 3
>1274304364 morph-cluster0 receive_start 3:9 len 84
>1274304364 morph-cluster0 match_change 3:9 matches cg 1
>1274304364 morph-cluster0 wait_messages cg 1 need 1 of 3
>1274304364 morph-cluster0 receive_start 4:2 len 84
>1274304364 morph-cluster0 match_change 4:2 matches cg 1
>1274304364 morph-cluster0 wait_messages cg 1 got all 3
>1274304364 morph-cluster0 start_kernel cg 1 member_count 3
>1274304364 write "1773172011" to "/sys/kernel/dlm/morph-cluster0/id"
>1274304364 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster0/nodes/1"
>1274304364 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster0/nodes/3"
>1274304364 set_members mkdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster0/nodes/4"
>1274304364 write "1" to "/sys/kernel/dlm/morph-cluster0/control"
>1274304364 write "0" to "/sys/kernel/dlm/morph-cluster0/event_done"
>1274304364 morph-cluster0 set_plock_ckpt_node from 0 to 3
>1274304364 morph-cluster0 receive_plocks_stored 3:9 flags a sig 0 need_plocks 1
>1274304364 morph-cluster0 match_change 3:9 matches cg 1
>1274304364 morph-cluster0 retrieve_plocks
>1274304364 morph-cluster0 retrieve_plocks first 0 last 0 r_count 0 p_count 0 sig 0
>1274304702 cluster node 3 removed
>1274304702 del_configfs_node rmdir "/sys/kernel/config/dlm/cluster/comms/3"
>1274304702 cluster node 4 removed
>1274304702 del_configfs_node rmdir "/sys/kernel/config/dlm/cluster/comms/4"
>1274304702 dlm:controld conf 2 0 1 memb 1 4 join left 3
>1274304702 dlm:controld conf 1 0 1 memb 1 join left 4
>1274304702 morph-cluster1 set_fs_notified 3 zero check_fs
>1274304702 dlm:ls:clvmd conf 2 0 1 memb 1 4 join left 3
>1274304702 clvmd add_change cg 2 remove nodeid 3 reason 3
>1274304702 clvmd add_change cg 2 counts member 2 joined 0 remove 1 failed 1
>1274304702 clvmd stop_kernel cg 2
>1274304702 write "0" to "/sys/kernel/dlm/clvmd/control"
>1274304702 clvmd check_fencing 3 not fenced add 1274304347 fence 0
>1274304702 dlm:ls:clvmd conf 1 0 1 memb 1 join left 4
>1274304702 clvmd add_change cg 3 remove nodeid 4 reason 3
>1274304702 clvmd add_change cg 3 counts member 1 joined 0 remove 1 failed 1
>1274304702 clvmd check_fencing 4 not fenced add 1274304347 fence 0
>1274304702 dlm:ls:morph-cluster1 conf 2 0 1 memb 1 4 join left 3
>1274304702 morph-cluster1 check_fs nodeid 3 set
>1274304702 morph-cluster1 add_change cg 2 remove nodeid 3 reason 3
>1274304702 morph-cluster1 add_change cg 2 counts member 2 joined 0 remove 1 failed 1
>1274304702 morph-cluster1 stop_kernel cg 2
>1274304702 write "0" to "/sys/kernel/dlm/morph-cluster1/control"
>1274304702 morph-cluster1 check_fencing 3 not fenced add 1274304363 fence 0
>1274304702 dlm:ls:morph-cluster1 conf 1 0 1 memb 1 join left 4
>1274304702 morph-cluster1 check_fs nodeid 4 set
>1274304702 morph-cluster1 add_change cg 3 remove nodeid 4 reason 3
>1274304702 morph-cluster1 add_change cg 3 counts member 1 joined 0 remove 1 failed 1
>1274304702 morph-cluster1 check_fencing 4 not fenced add 1274304363 fence 0
>1274304702 dlm:ls:morph-cluster2 conf 2 0 1 memb 1 4 join left 3
>1274304702 morph-cluster2 check_fs nodeid 3 set
>1274304702 morph-cluster2 add_change cg 2 remove nodeid 3 reason 3
>1274304702 morph-cluster2 add_change cg 2 counts member 2 joined 0 remove 1 failed 1
>1274304702 morph-cluster2 stop_kernel cg 2
>1274304702 write "0" to "/sys/kernel/dlm/morph-cluster2/control"
>1274304702 morph-cluster2 check_fencing 3 not fenced add 1274304363 fence 0
>1274304702 dlm:ls:morph-cluster2 conf 1 0 1 memb 1 join left 4
>1274304702 morph-cluster2 check_fs nodeid 4 set
>1274304702 morph-cluster2 add_change cg 3 remove nodeid 4 reason 3
>1274304702 morph-cluster2 add_change cg 3 counts member 1 joined 0 remove 1 failed 1
>1274304702 morph-cluster2 check_fencing 4 not fenced add 1274304363 fence 0
>1274304702 dlm:ls:morph-cluster0 conf 2 0 1 memb 1 4 join left 3
>1274304702 morph-cluster0 check_fs nodeid 3 set
>1274304702 morph-cluster0 add_change cg 2 remove nodeid 3 reason 3
>1274304702 morph-cluster0 add_change cg 2 counts member 2 joined 0 remove 1 failed 1
>1274304702 morph-cluster0 stop_kernel cg 2
>1274304702 write "0" to "/sys/kernel/dlm/morph-cluster0/control"
>1274304702 morph-cluster0 check_fencing 3 not fenced add 1274304364 fence 0
>1274304702 dlm:ls:morph-cluster0 conf 1 0 1 memb 1 join left 4
>1274304702 morph-cluster0 check_fs nodeid 4 set
>1274304702 morph-cluster0 add_change cg 3 remove nodeid 4 reason 3
>1274304702 morph-cluster0 add_change cg 3 counts member 1 joined 0 remove 1 failed 1
>1274304702 morph-cluster0 check_fencing 4 not fenced add 1274304364 fence 0
>1274304702 morph-cluster2 set_fs_notified nodeid 3
>1274304702 morph-cluster0 set_fs_notified nodeid 3
>1274304702 morph-cluster1 set_fs_notified nodeid 3
>1274304702 morph-cluster2 set_fs_notified nodeid 4
>1274304702 morph-cluster0 set_fs_notified nodeid 4
>1274304702 morph-cluster1 set_fs_notified nodeid 4
>1274304741 cluster node 3 added
>1274304741 set_configfs_node 3 10.15.89.63 local 0
>1274304744 dlm:controld conf 2 1 0 memb 1 3 join 3 left
>1274304752 dlm:ls:clvmd conf 2 1 0 memb 1 3 join 3 left
>1274304752 clvmd add_change cg 4 joined nodeid 3
>1274304752 clvmd add_change cg 4 counts member 2 joined 1 remove 0 failed 0
>1274304754 clvmd receive_start 3:1 len 80
>1274304754 clvmd match_change 3:1 skip 2 sender not member
>1274304754 clvmd match_change 3:1 skip 3 sender not member
>1274304754 clvmd match_change 3:1 matches cg 4
>1274304754 clvmd check_fencing 3 not fenced add 1274304754 fence 1274304753
>1274304754 clvmd check_fencing 4 1274304347 fenced at 1274304753
>1274304754 morph-cluster0 check_fencing 3 1274304364 fenced at 1274304753
>1274304754 morph-cluster0 check_fencing 4 1274304364 fenced at 1274304753
>1274304754 morph-cluster0 check_fencing done
>1274304754 morph-cluster0 check_quorum disabled
>1274304754 morph-cluster0 check_fs nodeid 3 clear
>1274304754 morph-cluster0 check_fs nodeid 4 clear
>1274304754 morph-cluster0 check_fs done
>1274304754 morph-cluster0 send_start cg 3 flags 2 data2 0 counts 1 1 0 1 1
>1274304754 morph-cluster2 check_fencing 3 1274304363 fenced at 1274304753
>1274304754 morph-cluster2 check_fencing 4 1274304363 fenced at 1274304753
>1274304754 morph-cluster2 check_fencing done
>1274304754 morph-cluster2 check_quorum disabled
>1274304754 morph-cluster2 check_fs nodeid 3 clear
>1274304754 morph-cluster2 check_fs nodeid 4 clear
>1274304754 morph-cluster2 check_fs done
>1274304754 morph-cluster2 send_start cg 3 flags 2 data2 0 counts 1 1 0 1 1
>1274304754 morph-cluster1 check_fencing 3 1274304363 fenced at 1274304753
>1274304754 morph-cluster1 check_fencing 4 1274304363 fenced at 1274304753
>1274304754 morph-cluster1 check_fencing done
>1274304754 morph-cluster1 check_quorum disabled
>1274304754 morph-cluster1 check_fs nodeid 3 clear
>1274304754 morph-cluster1 check_fs nodeid 4 clear
>1274304754 morph-cluster1 check_fs done
>1274304754 morph-cluster1 send_start cg 3 flags 2 data2 0 counts 1 1 0 1 1
>1274304754 morph-cluster2 receive_start 1:3 len 76
>1274304754 morph-cluster2 match_change 1:3 skip 2 expect counts 2 0 1 1
>1274304754 morph-cluster2 match_change 1:3 matches cg 3
>1274304754 morph-cluster2 wait_messages cg 3 got all 1
>1274304754 morph-cluster2 start_kernel cg 3 member_count 1
>1274304754 dir_member 4
>1274304754 dir_member 3
>1274304754 dir_member 1
>1274304754 set_members rmdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster2/nodes/4"
>1274304754 set_members rmdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster2/nodes/3"
>1274304754 write "1" to "/sys/kernel/dlm/morph-cluster2/control"
>1274304754 morph-cluster0 receive_start 1:3 len 76
>1274304754 morph-cluster0 match_change 1:3 skip 2 expect counts 2 0 1 1
>1274304754 morph-cluster0 match_change 1:3 matches cg 3
>1274304754 morph-cluster0 wait_messages cg 3 got all 1
>1274304754 morph-cluster0 start_kernel cg 3 member_count 1
>1274304754 dir_member 4
>1274304754 dir_member 3
>1274304754 dir_member 1
>1274304754 set_members rmdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster0/nodes/4"
>1274304754 set_members rmdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster0/nodes/3"
>1274304754 write "1" to "/sys/kernel/dlm/morph-cluster0/control"
>1274304754 morph-cluster1 wait_messages cg 3 need 1 of 1
>1274304754 morph-cluster1 receive_start 1:3 len 76
>1274304754 morph-cluster1 match_change 1:3 skip 2 expect counts 2 0 1 1
>1274304754 morph-cluster1 match_change 1:3 matches cg 3
>1274304754 morph-cluster1 wait_messages cg 3 got all 1
>1274304754 morph-cluster1 start_kernel cg 3 member_count 1
>1274304754 dir_member 4
>1274304754 dir_member 3
>1274304754 dir_member 1
>1274304754 set_members rmdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster1/nodes/4"
>1274304754 set_members rmdir "/sys/kernel/config/dlm/cluster/spaces/morph-cluster1/nodes/3"
>1274304754 write "1" to "/sys/kernel/dlm/morph-cluster1/control"
>1274304824 cluster node 4 added
>1274304824 set_configfs_node 4 10.15.89.64 local 0
>1274304828 dlm:controld conf 3 1 0 memb 1 3 4 join 4 left
>1274304832 dlm:ls:clvmd conf 3 1 0 memb 1 3 4 join 4 left
>1274304832 clvmd add_change cg 5 joined nodeid 4
>1274304832 clvmd add_change cg 5 counts member 3 joined 1 remove 0 failed 0
>1274304832 clvmd receive_start 4:1 len 84
>1274304832 clvmd match_change 4:1 skip cg 2 created 1274304702 cluster add 1274304824
>1274304832 clvmd match_change 4:1 skip 3 sender not member
>1274304832 clvmd match_change 4:1 skip 4 sender not member
>1274304832 clvmd match_change 4:1 matches cg 5
>1274304832 clvmd receive_start 3:2 len 84
>1274304832 clvmd match_change 3:2 skip 2 sender not member
>1274304832 clvmd match_change 3:2 skip 3 sender not member
>1274304832 clvmd match_change 3:2 skip 4 already start
>1274304832 clvmd match_change 3:2 matches cg 5

Actions: View

Attachments on bug 594511: 415521 | 415522 | 415523 | 415524 | 415525