Attachment 854513 Details for Bug 1057258 – Extract from /var/log/messages.

Extract from /var/log/messages.

log_messages (text/plain), 12.14 KB, created by Miroslav Lisik on 2014-01-23 17:33:57 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Miroslav Lisik

Created: 2014-01-23 17:33:57 UTC

Size: 12.14 KB

patch

obsolete

>Jan 23 17:49:24 virt-076 corosync[13690]: [TOTEM ] A processor failed, forming new configuration.
>Jan 23 17:49:25 virt-076 corosync[13690]: [TOTEM ] A new membership (10.34.71.74:52) was formed. Members left: 2
>Jan 23 17:49:25 virt-076 crmd[13711]: notice: peer_update_callback: Our peer on the DC is dead
>Jan 23 17:49:25 virt-076 crmd[13711]: notice: do_state_transition: State transition S_NOT_DC -> S_ELECTION [ input=I_ELECTION cause=C_CRMD_STATUS_CALLBACK origin=peer_update_callback ]
>Jan 23 17:49:25 virt-076 corosync[13690]: [QUORUM] Members[2]: 1 3
>Jan 23 17:49:25 virt-076 corosync[13690]: [MAIN  ] Completed service synchronization, ready to provide service.
>Jan 23 17:49:25 virt-076 crmd[13711]: notice: crm_update_peer_state: pcmk_quorum_notification: Node virt-075.cluster-qe.lab.eng.brq.redhat.com[2] - state is now lost (was member)
>Jan 23 17:49:25 virt-076 pacemakerd[13705]: notice: crm_update_peer_state: pcmk_quorum_notification: Node virt-075.cluster-qe.lab.eng.brq.redhat.com[2] - state is now lost (was member)
>Jan 23 17:49:25 virt-076 crmd[13711]: notice: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
>Jan 23 17:49:26 virt-076 crmd[13711]: notice: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
>Jan 23 17:49:26 virt-076 attrd[13709]: notice: attrd_local_callback: Sending full refresh (origin=crmd)
>Jan 23 17:49:26 virt-076 attrd[13709]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (8 9): @ 0x7fff9c021640 --
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (15 16): = virt-076.cluster-qe.lab.eng.brq.redhat.com
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (11 12): = 6
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (21 22): = /etc/cluster/fence_xvm.key
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (23 49): /etc/cluster/fence_xvm.key
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (17 18): = 2
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (17 18): = 225.0.0.12
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (17 18): = 2
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (17 18): = 1229
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (20 21): = 0
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (19 20): = 2
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (16 17): = 30
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (18 19): = 20
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (14 15): = 0
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (14 15): = 10
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (20 46): /etc/cluster/fence_xvm.key into 0x7fff9c0205f0 (4096 max size)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (67 72): (4096 max size)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (16 17): @ 17 bytes
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (18 19): = 17 bytes
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (49 56): (family 10)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (51 58): (family 10)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (28 35): (family 2)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (30 37): (family 2)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (31 38): (family 2)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (25 26): = 3
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (31 48): (225.0.0.12:1229)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 1)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 2)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (26 27): = 4
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (8 20): /dev/urandom
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (31 48): (225.0.0.12:1229)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 1)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 2)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (26 27): = 4
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (8 20): /dev/urandom
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (31 48): (225.0.0.12:1229)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 1)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 2)
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (26 27): = 4
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (8 20): /dev/urandom
>Jan 23 17:49:27 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (13 14): + Authentication done...
>Jan 23 17:49:29 virt-076 stonith-ng[13707]: error: child_death_dispatch: Managed process 13734 (list) dumped core
>Jan 23 17:49:29 virt-076 stonith-ng[13707]: notice: stonith_action_async_done: Child process 13734 performing action 'list' timed out with signal 6
>Jan 23 17:49:29 virt-076 stonith-ng[13707]: error: child_death_dispatch: Managed process 13735 (list) dumped core
>Jan 23 17:49:29 virt-076 stonith-ng[13707]: notice: stonith_action_async_done: Child process 13735 performing action 'list' timed out with signal 6
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (8 9): @ 0x7fffd6338a90 --
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (15 16): = virt-074.cluster-qe.lab.eng.brq.redhat.com
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (11 12): = 6
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (21 22): = /etc/cluster/fence_xvm.key
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (23 49): /etc/cluster/fence_xvm.key
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (17 18): = 2
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (17 18): = 225.0.0.12
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (17 18): = 2
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (17 18): = 1229
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (20 21): = 0
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (19 20): = 2
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (16 17): = 30
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (18 19): = 20
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (14 15): = 0
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (14 15): = 10
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (20 46): /etc/cluster/fence_xvm.key into 0x7fffd6337a40 (4096 max size)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (67 72): (4096 max size)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (16 17): @ 17 bytes
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (18 19): = 17 bytes
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (49 56): (family 10)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (51 58): (family 10)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (28 35): (family 2)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (30 37): (family 2)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (31 38): (family 2)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (25 26): = 3
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (31 48): (225.0.0.12:1229)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 1)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 2)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (26 27): = 4
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (8 20): /dev/urandom
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (31 48): (225.0.0.12:1229)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 1)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 2)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (26 27): = 4
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (8 20): /dev/urandom
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (31 48): (225.0.0.12:1229)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 1)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (27 32): (pass 2)
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (26 27): = 4
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (8 20): /dev/urandom
>Jan 23 17:49:30 virt-076 stonith-ng[13707]: warning: parse_host_line: Could not parse (13 14): + Authentication done...
>Jan 23 17:49:32 virt-076 stonith-ng[13707]: error: child_death_dispatch: Managed process 13741 (list) dumped core
>Jan 23 17:49:32 virt-076 stonith-ng[13707]: notice: stonith_action_async_done: Child process 13741 performing action 'list' timed out with signal 6
>Jan 23 17:49:32 virt-076 stonith-ng[13707]: notice: dynamic_list_search_cb: Disabling port list queries for xvm-075 (-103): *** buffer overflow detected ***: fence_xvm terminated
>======= Backtrace: =========
>/lib64/libc.so.6(__fortify_fail+0x37)[0x7f7095d5faf7]
>/lib64/libc.so.6(+0x10bcc0)[0x7f7095d5dcc0]
>/lib64/libc.so.6(+0x10da67)[0x7f7095d5fa67]
>fence_xvm[0x402023]
>fence_xvm[0x4019de]
>/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f7095c73af5]
>fence_xvm[0x401b31]
>======= Memory map: ========
>00400000-0040a000 r-xp 00000000 fd:01 26141278
>Jan 23 17:49:32 virt-076 stonith-ng[13707]: notice: remote_op_done: Operation reboot of virt-075.cluster-qe.lab.eng.brq.redhat.com by virt-074.cluster-qe.lab.eng.brq.redhat.com for crmd.2458@virt-074.cluster-qe.lab.eng.brq.redhat.com.49efcf18: No such device
>Jan 23 17:49:32 virt-076 crmd[13711]: notice: tengine_stonith_notify: Peer virt-075.cluster-qe.lab.eng.brq.redhat.com was not terminated (reboot) by virt-074.cluster-qe.lab.eng.brq.redhat.com for virt-074.cluster-qe.lab.eng.brq.redhat.com: No such device (ref=49efcf18-b268-45ab-a750-8b6b2aafab17) by client crmd.2458
>Jan 23 17:50:01 virt-076 systemd: Starting Session 25 of user root.

Actions: View

Attachments on bug 1057258: 854513 | 856062