Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 935701 Details for
Bug 1139701
systemd resources operations timeout and get unmanaged
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
Pacemaker logs files from
pacemaker_event.log (text/plain), 428.36 KB, created by
Jeff Dexter
on 2014-09-09 13:31:09 UTC
(
hide
)
Description:
Pacemaker logs files from
Filename:
MIME Type:
Creator:
Jeff Dexter
Created:
2014-09-09 13:31:09 UTC
Size:
428.36 KB
patch
obsolete
>Aug 21 12:58:32 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 12:58:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 12:58:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 12:58:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/262, version=0.10.3) >Aug 21 12:58:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 12:58:32 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 12:58:32 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 12:58:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: stage6: Delaying fencing operations until there are resources to manage >Aug 21 12:58:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 125: /var/lib/pacemaker/pengine/pe-input-14.bz2 >Aug 21 12:58:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 12:58:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 125 (ref=pe_calc-dc-1408643912-193) derived from /var/lib/pacemaker/pengine/pe-input-14.bz2 >Aug 21 12:58:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 125 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-14.bz2): Complete >Aug 21 12:58:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 12:58:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 12:58:40 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x204fdc0 for uid=0 gid=0 pid=39143 id=12abbe9f-7437-4784-9777-4deaf01ee9d7 >Aug 21 12:58:40 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.10.3) >Aug 21 12:58:40 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 12:58:40 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x204fdc0 for uid=0 gid=0 pid=39144 id=eebeeb5a-1c01-400f-b2dd-402c3c38f165 >Aug 21 12:58:40 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.10.3) >Aug 21 12:58:40 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: info: pcmk_quorum_notification: Membership 12: quorum retained (3) >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_quorum_notification: Membership 12: quorum retained (3) >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: info: pcmk_quorum_notification: Membership 12: quorum retained (3) >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_get_peer: Created entry 398d2a37-228d-49d0-9408-6c3823590fb0/0x8f90d0 for node (null)/3 (3 total) >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: info: crm_get_peer: Created entry ddac08db-9b4e-4802-9777-41f7e0325416/0xe3ab70 for node (null)/3 (3 total) >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: info: crm_get_peer: Created entry ddac08db-9b4e-4802-9777-41f7e0325416/0xe3ab70 for node (null)/3 (3 total) >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_get_peer: Node 3 is now known as d-6q2lmw1 >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: info: peer_update_callback: d-6q2lmw1 is now (null) >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_get_peer: Node 3 has uuid 3 >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: notice: crm_update_peer_state: pcmk_quorum_notification: Node d-6q2lmw1[3] - state is now member (was (null)) >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: info: peer_update_callback: d-6q2lmw1 is now member (was (null)) >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/263, version=0.10.4) >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: info: crm_get_peer: Node 3 is now known as d-6q2lmw1 >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: info: crm_get_peer: Node 3 is now known as d-6q2lmw1 >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: info: crm_get_peer: Node 3 has uuid 3 >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: info: crm_get_peer: Node 3 has uuid 3 >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: notice: crm_update_peer_state: pcmk_quorum_notification: Node d-6q2lmw1[3] - state is now member (was (null)) >Aug 21 12:59:53 [11655] d-d9ckmw1.hq.target.com pacemakerd: notice: crm_update_peer_state: pcmk_quorum_notification: Node d-6q2lmw1[3] - state is now member (was (null)) >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: --- 0.10.4 >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: +++ 0.11.1 c6fa6f38a5d5aaf086b1ae8656d53b79 >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <cib admin_epoch="0" epoch="10" num_updates="4"/> >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <node id="3" uname="d-6q2lmw1"/> >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/264, version=0.11.1) >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=1, node=, tag=diff, id=(null), magic=NA, cib=0.11.1) : Non-status change >Aug 21 12:59:53 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/265, version=0.11.2) >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/266, version=0.11.2) >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-9.raw >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.11.0 of the CIB to disk (digest: c7bb9a6dd7a9375dcca3b6120ecc0d13) >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.vOs67I (digest: /var/lib/pacemaker/cib/cib.jHW8nV) >Aug 21 12:59:53 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: pcmk_cpg_membership: Joined[4.0] stonith-ng.3 >Aug 21 12:59:53 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: pcmk_cpg_membership: Member[4.0] stonith-ng.1 >Aug 21 12:59:53 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: pcmk_cpg_membership: Member[4.1] stonith-ng.2 >Aug 21 12:59:53 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: crm_get_peer: Created entry b12699f1-c042-4ece-b29a-a1d9b5d60fa8/0x1c20000 for node (null)/3 (3 total) >Aug 21 12:59:53 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: crm_get_peer: Node 3 is now known as d-6q2lmw1 >Aug 21 12:59:53 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: crm_get_peer: Node 3 has uuid 3 >Aug 21 12:59:53 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: pcmk_cpg_membership: Member[4.2] stonith-ng.3 >Aug 21 12:59:53 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: crm_update_peer_proc: pcmk_cpg_membership: Node d-6q2lmw1[3] - corosync-cpg is now online >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: pcmk_cpg_membership: Joined[4.0] cib.3 >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: pcmk_cpg_membership: Member[4.0] cib.1 >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: pcmk_cpg_membership: Member[4.1] cib.2 >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: crm_get_peer: Created entry bc0989ab-eb59-4f8d-ac1b-8106791119ad/0x20508c0 for node (null)/3 (3 total) >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: crm_get_peer: Node 3 is now known as d-6q2lmw1 >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: crm_get_peer: Node 3 has uuid 3 >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: pcmk_cpg_membership: Member[4.2] cib.3 >Aug 21 12:59:53 [11656] d-d9ckmw1.hq.target.com cib: info: crm_update_peer_proc: pcmk_cpg_membership: Node d-6q2lmw1[3] - corosync-cpg is now online >Aug 21 12:59:54 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/267, version=0.11.2) >Aug 21 12:59:54 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 12:59:54 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 12:59:54 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 12:59:54 [11660] d-d9ckmw1.hq.target.com pengine: notice: stage6: Delaying fencing operations until there are resources to manage >Aug 21 12:59:54 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 126: /var/lib/pacemaker/pengine/pe-input-15.bz2 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 126 (ref=pe_calc-dc-1408643994-195) derived from /var/lib/pacemaker/pengine/pe-input-15.bz2 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 126 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_cpg_membership: Joined[4.0] crmd.3 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_cpg_membership: Member[4.0] crmd.1 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_cpg_membership: Member[4.1] crmd.2 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_cpg_membership: Member[4.2] crmd.3 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_proc: pcmk_cpg_membership: Node d-6q2lmw1[3] - corosync-cpg is now online >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: peer_update_callback: Client d-6q2lmw1/peer now has status [online] (DC=true) >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_FSA_INTERNAL origin=peer_update_callback ] >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: do_dc_join_offer_one: An unknown node joined - (re-)offer to any unconfirmed nodes >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: join_make_offer: Making join offers based on membership 12 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: join_make_offer: Skipping d-d9ckmw1: already known 4 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: join_make_offer: join-4: Sending offer to d-6q2lmw1 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: join_make_offer: Node d-6q2lmw1[3] - join-4 phase 0 -> 1 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: join_make_offer: Skipping d-gqynnw1: already known 4 >Aug 21 12:59:54 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: do_te_invoke:158 - Triggered transition abort (complete=1) : Peer Halt >Aug 21 12:59:54 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/268, version=0.11.3) >Aug 21 12:59:54 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_sync_one operation for section 'all': OK (rc=0, origin=d-6q2lmw1/d-6q2lmw1/(null), version=0.11.3) >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: do_dc_join_offer_one: join-4: Processing join_announce request from d-6q2lmw1 in state S_INTEGRATION >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: do_dc_join_offer_one: Node d-6q2lmw1[3] - join-4 phase 1 -> 0 >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: join_make_offer: join-4: Sending offer to d-6q2lmw1 >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: join_make_offer: Node d-6q2lmw1[3] - join-4 phase 0 -> 1 >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: join_make_offer: Node d-d9ckmw1[1] - join-4 phase 4 -> 0 >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: join_make_offer: join-4: Sending offer to d-d9ckmw1 >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: join_make_offer: Node d-d9ckmw1[1] - join-4 phase 0 -> 1 >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: do_dc_join_offer_one:236 - Triggered transition abort (complete=1) : Node join >Aug 21 12:59:55 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/269, version=0.11.3) >Aug 21 12:59:55 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node d-d9ckmw1[1] - join-4 phase 1 -> 2 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node d-6q2lmw1[3] - join-4 phase 1 -> 2 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_expected: do_dc_join_filter_offer: Node d-6q2lmw1[3] - expected state is now member (was (null)) >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crmd_join_phase_log: join-4: d-d9ckmw1=integrated >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crmd_join_phase_log: join-4: d-6q2lmw1=integrated >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crmd_join_phase_log: join-4: d-gqynnw1=confirmed >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_dc_join_finalize: join-4: Syncing our CIB to the rest of the cluster >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_JOIN_REQUEST cause=C_HA_MESSAGE origin=route_message ] >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_dc_join_offer_one: join-4: Processing join_request request from d-6q2lmw1 in state S_INTEGRATION >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: do_dc_join_offer_one: Node d-6q2lmw1[3] - join-4 phase 2 -> 0 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: join_make_offer: join-4: Sending offer to d-6q2lmw1 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: join_make_offer: Node d-6q2lmw1[3] - join-4 phase 0 -> 1 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: join_make_offer: Node d-d9ckmw1[1] - join-4 phase 2 -> 0 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: join_make_offer: join-4: Sending offer to d-d9ckmw1 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: join_make_offer: Node d-d9ckmw1[1] - join-4 phase 0 -> 1 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: do_dc_join_offer_one:236 - Triggered transition abort (complete=1) : Node join >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_sync operation for section 'all': OK (rc=0, origin=local/crmd/270, version=0.11.3) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/271, version=0.11.3) >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node d-d9ckmw1[1] - join-4 phase 1 -> 2 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node d-6q2lmw1[3] - join-4 phase 1 -> 2 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crmd_join_phase_log: join-4: d-d9ckmw1=integrated >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crmd_join_phase_log: join-4: d-6q2lmw1=integrated >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crmd_join_phase_log: join-4: d-gqynnw1=confirmed >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_dc_join_finalize: join-4: Syncing our CIB to the rest of the cluster >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_sync operation for section 'all': OK (rc=0, origin=local/crmd/272, version=0.11.3) >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: finalize_join_for: Node d-d9ckmw1[1] - join-4 phase 2 -> 3 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: finalize_join_for: Node d-6q2lmw1[3] - join-4 phase 2 -> 3 >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/273, version=0.11.3) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/274, version=0.11.3) >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: do_dc_join_ack: Node d-d9ckmw1[1] - join-4 phase 3 -> 4 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_dc_join_ack: join-4: Updating node state to member for d-d9ckmw1 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: erase_status_tag: Deleting xpath: //node_state[@uname='d-d9ckmw1']/lrm >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='d-d9ckmw1']/lrm: OK (rc=0, origin=local/crmd/275, version=0.11.4) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='d-6q2lmw1']/transient_attributes: OK (rc=0, origin=d-6q2lmw1/crmd/10, version=0.11.4) >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_update_peer_join: do_dc_join_ack: Node d-6q2lmw1[3] - join-4 phase 3 -> 4 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_dc_join_ack: join-4: Updating node state to member for d-6q2lmw1 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: erase_status_tag: Deleting xpath: //node_state[@uname='d-6q2lmw1']/lrm >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/276, version=0.11.5) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='d-6q2lmw1']/lrm: OK (rc=0, origin=local/crmd/277, version=0.11.5) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/278, version=0.11.6) >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: do_te_invoke:151 - Triggered transition abort (complete=1) : Peer Cancelled >Aug 21 12:59:56 [11659] d-d9ckmw1.hq.target.com attrd: notice: attrd_local_callback: Sending full refresh (origin=crmd) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/279, version=0.11.6) >Aug 21 12:59:56 [11659] d-d9ckmw1.hq.target.com attrd: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/280, version=0.11.6) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section cib: OK (rc=0, origin=local/crmd/281, version=0.11.6) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/282, version=0.11.6) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='1']//transient_attributes//nvpair[@name='probe_complete']: OK (rc=0, origin=local/attrd/38, version=0.11.6) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/39, version=0.11.6) >Aug 21 12:59:56 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 12:59:56 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 12:59:56 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 12:59:56 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 12:59:56 [11660] d-d9ckmw1.hq.target.com pengine: notice: stage6: Delaying fencing operations until there are resources to manage >Aug 21 12:59:56 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 127: /var/lib/pacemaker/pengine/pe-input-16.bz2 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 127 (ref=pe_calc-dc-1408643996-206) derived from /var/lib/pacemaker/pengine/pe-input-16.bz2 >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 2: probe_complete probe_complete-d-6q2lmw1 on d-6q2lmw1 - no waiting >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 2 confirmed - no wait >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 127 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-16.bz2): Complete >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 12:59:56 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/attrd/12, version=0.11.6) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='1']//transient_attributes//nvpair[@name='probe_complete']: OK (rc=0, origin=local/attrd/40, version=0.11.6) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/41, version=0.11.6) >Aug 21 12:59:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/attrd/14, version=0.11.6) >Aug 21 12:59:58 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/attrd/6, version=0.11.7) >Aug 21 13:00:01 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=39367 id=436e8ad5-9c71-4016-8134-f0221882ff54 >Aug 21 13:00:01 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.11.7) >Aug 21 13:00:01 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:00:01 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=39369 id=24114236-5bd0-4bae-a9f9-07d0dcc9c3db >Aug 21 13:00:01 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.11.7) >Aug 21 13:00:01 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:14:56 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 13:14:56 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 13:14:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 13:14:56 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/283, version=0.11.7) >Aug 21 13:14:56 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:14:56 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:14:56 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:14:56 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:14:56 [11660] d-d9ckmw1.hq.target.com pengine: notice: stage6: Delaying fencing operations until there are resources to manage >Aug 21 13:14:56 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 128: /var/lib/pacemaker/pengine/pe-input-17.bz2 >Aug 21 13:14:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:14:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 128 (ref=pe_calc-dc-1408644896-208) derived from /var/lib/pacemaker/pengine/pe-input-17.bz2 >Aug 21 13:14:56 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 128 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-17.bz2): Complete >Aug 21 13:14:56 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 13:14:56 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=42267 id=48955e5c-053b-4381-9877-5199d4514bae >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //resources/descendant::primitive[@id="haproxy-vip"]: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.11.7) >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=42276 id=f1112a46-9147-4d37-8f81-1e8a6ce435d2 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: --- 0.11.7 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: +++ 0.12.1 2fbae68e85654a4d6f799e7c38b9fbb9 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <cib admin_epoch="0" epoch="11" num_updates="7"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="ocf" id="haproxy-vip" provider="heartbeat" type="IPaddr2"> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="haproxy-vip-instance_attributes"> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <nvpair id="haproxy-vip-instance_attributes-ip" name="ip" value="10.63.28.215"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </instance_attributes> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="haproxy-vip-start-timeout-20s" interval="0s" name="start" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="haproxy-vip-stop-timeout-20s" interval="0s" name="stop" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="haproxy-vip-monitor-interval-10s" interval="10s" name="monitor" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=1, node=, tag=diff, id=(null), magic=NA, cib=0.12.1) : Non-status change >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_create operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.12.1) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] >Aug 21 13:18:32 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/284, version=0.12.1) >Aug 21 13:18:32 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Stopped >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (10s) for haproxy-vip on d-6q2lmw1 >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start haproxy-vip (d-6q2lmw1) >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-10.raw >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 129: /var/lib/pacemaker/pengine/pe-input-18.bz2 >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 129 (ref=pe_calc-dc-1408645112-209) derived from /var/lib/pacemaker/pengine/pe-input-18.bz2 >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 8: monitor haproxy-vip_monitor_0 on d-gqynnw1 >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 6: monitor haproxy-vip_monitor_0 on d-d9ckmw1 (local) >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.12.0 of the CIB to disk (digest: fbdbc0460a6adfba1f10a1d2f375ad47) >Aug 21 13:18:32 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_get_rsc_info: Resource 'haproxy-vip' not found (0 active resources) >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.7dGuPy (digest: /var/lib/pacemaker/cib/cib.q9YILa) >Aug 21 13:18:32 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_rsc_register: Added 'haproxy-vip' to the rsc list (1 active resources) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=6:129:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=haproxy-vip_monitor_0 >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 4: monitor haproxy-vip_monitor_0 on d-6q2lmw1 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=42278 id=ca5d60c9-973a-44cb-bd06-811983e67e73 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.12.1) >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=42282 id=abf7ad2d-187c-426b-a4bd-67b49fe49c22 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: log_cib_diff: cib:diff: Local-only Change: 0.13.1 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <primitive class="ocf" id="haproxy-vip" provider="heartbeat" type="IPaddr2"> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <instance_attributes id="haproxy-vip-instance_attributes"> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <nvpair id="haproxy-vip-instance_attributes-ip" name="ip" value="10.63.28.215"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </instance_attributes> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <operations> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="haproxy-vip-start-timeout-20s" interval="0s" name="start" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="haproxy-vip-stop-timeout-20s" interval="0s" name="stop" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="haproxy-vip-monitor-interval-10s" interval="10s" name="monitor" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </operations> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </primitive> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <group id="haproxy-group"> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="ocf" id="haproxy-vip" provider="heartbeat" type="IPaddr2"> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="haproxy-vip-instance_attributes"> >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.13.1) : Non-status change >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <nvpair id="haproxy-vip-instance_attributes-ip" name="ip" value="10.63.28.215"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </instance_attributes> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="haproxy-vip-start-timeout-20s" interval="0s" name="start" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="haproxy-vip-stop-timeout-20s" interval="0s" name="stop" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="haproxy-vip-monitor-interval-10s" interval="10s" name="monitor" timeout="20s"/> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </group> >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_replace operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.13.1) >Aug 21 13:18:32 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:18:32 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-11.raw >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.13.0 of the CIB to disk (digest: 150e1addb9ff54168ac9d4baf0ace935) >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.0FTTwz (digest: /var/lib/pacemaker/cib/cib.8K6zyb) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: services_os_action_execute: Managed IPaddr2_meta-data_0 process 42327 exited with rc=0 >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation haproxy-vip_monitor_0 (call=14, rc=7, cib-update=285, confirmed=true) not running >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/285, version=0.13.2) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-vip_monitor_0 (6) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 5: probe_complete probe_complete-d-d9ckmw1 on d-d9ckmw1 (local) - no waiting >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 5 confirmed - no wait >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/14, version=0.13.3) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-vip_monitor_0 (8) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 7: probe_complete probe_complete-d-gqynnw1 on d-gqynnw1 - no waiting >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 7 confirmed - no wait >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/11, version=0.13.4) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-vip_monitor_0 (4) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 3: probe_complete probe_complete-d-6q2lmw1 on d-6q2lmw1 - no waiting >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 3 confirmed - no wait >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 129 (Complete=6, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-18.bz2): Stopped >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/286, version=0.13.4) >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Stopped >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (10s) for haproxy-vip on d-6q2lmw1 >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start haproxy-vip (d-6q2lmw1) >Aug 21 13:18:32 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 130: /var/lib/pacemaker/pengine/pe-input-19.bz2 >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 130 (ref=pe_calc-dc-1408645112-216) derived from /var/lib/pacemaker/pengine/pe-input-19.bz2 >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 6: start haproxy-vip_start_0 on d-6q2lmw1 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/12, version=0.13.5) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-vip_start_0 (6) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 7: monitor haproxy-vip_monitor_10000 on d-6q2lmw1 >Aug 21 13:18:32 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/13, version=0.13.6) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-vip_monitor_10000 (7) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 130 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-19.bz2): Complete >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 13:18:32 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:18:34 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21ed560 for uid=0 gid=0 pid=42337 id=26b017fa-2670-40f3-b4b9-30b6ac9f83c6 >Aug 21 13:18:34 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.13.6) >Aug 21 13:18:34 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:18:34 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21ed560 for uid=0 gid=0 pid=42338 id=f2d0972f-2b00-4391-968b-1027fe9c18c5 >Aug 21 13:18:34 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.13.6) >Aug 21 13:18:34 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:19:46 [42606] d-d9ckmw1.hq.target.com pacemakerd: info: crm_log_init: Changed active directory to /var/lib/pacemaker/cores/root >Aug 21 13:19:46 [42606] d-d9ckmw1.hq.target.com pacemakerd: info: crm_xml_cleanup: Cleaning up memory from libxml2 >Aug 21 13:19:46 [42635] d-d9ckmw1.hq.target.com pacemakerd: info: crm_log_init: Changed active directory to /var/lib/pacemaker/cores/root >Aug 21 13:19:46 [42635] d-d9ckmw1.hq.target.com pacemakerd: info: crm_xml_cleanup: Cleaning up memory from libxml2 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21ed560 for uid=0 gid=0 pid=42922 id=cda9c75b-ddc8-4056-889a-aaca38276260 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //resources/descendant::primitive[@id="haproxy-lb"]: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.13.6) >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21ed560 for uid=0 gid=0 pid=42923 id=aac73520-9f17-4081-8dae-7bf7fd5e63a5 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: --- 0.13.6 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: +++ 0.14.1 5269d80be49961c8861f74dad64a4e62 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <cib admin_epoch="0" epoch="13" num_updates="6"/> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="systemd" id="haproxy-lb" type="haproxy"> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="haproxy-lb-instance_attributes"/> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="haproxy-lb-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_create operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.14.1) >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=1, node=, tag=diff, id=(null), magic=NA, cib=0.14.1) : Non-status change >Aug 21 13:21:03 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] >Aug 21 13:21:03 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/287, version=0.14.1) >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-12.raw >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Stopped >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.14.0 of the CIB to disk (digest: 2abb08e527347239687fd2538d099b32) >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.1V4PG8 (digest: /var/lib/pacemaker/cib/cib.bjUSK4) >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for haproxy-lb on d-d9ckmw1 >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start haproxy-lb (d-d9ckmw1) >Aug 21 13:21:03 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 131: /var/lib/pacemaker/pengine/pe-input-20.bz2 >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 131 (ref=pe_calc-dc-1408645263-219) derived from /var/lib/pacemaker/pengine/pe-input-20.bz2 >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 9: monitor haproxy-lb_monitor_0 on d-gqynnw1 >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 7: monitor haproxy-lb_monitor_0 on d-d9ckmw1 (local) >Aug 21 13:21:03 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_get_rsc_info: Resource 'haproxy-lb' not found (1 active resources) >Aug 21 13:21:03 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_rsc_register: Added 'haproxy-lb' to the rsc list (2 active resources) >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=7:131:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=haproxy-lb_monitor_0 >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 5: monitor haproxy-lb_monitor_0 on d-6q2lmw1 >Aug 21 13:21:03 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_find_error: GetUnit error 'org.freedesktop.systemd1.NoSuchUnit': Unit haproxy.service is not loaded. >Aug 21 13:21:03 [11658] d-d9ckmw1.hq.target.com lrmd: info: systemd_unit_by_name: Call to GetUnit failed: org.freedesktop.systemd1.NoSuchUnit >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21ed560 for uid=0 gid=0 pid=42925 id=3d0e51f2-ea99-4fa1-9ff9-4d123e04a352 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.14.1) >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21ed560 for uid=0 gid=0 pid=42926 id=9aafa0ff-cd62-4ee2-93b5-0ccf3cab0b73 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: log_cib_diff: cib:diff: Local-only Change: 0.15.1 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <primitive class="systemd" id="haproxy-lb" type="haproxy"> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <instance_attributes id="haproxy-lb-instance_attributes"/> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <operations> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="haproxy-lb-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </operations> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </primitive> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="systemd" id="haproxy-lb" type="haproxy"> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="haproxy-lb-instance_attributes"/> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="haproxy-lb-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.15.1) : Non-status change >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_replace operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.15.1) >Aug 21 13:21:03 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:21:03 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-13.raw >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.15.0 of the CIB to disk (digest: 1a877a93d408ee4f27d9fe85e05dfae5) >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.teHBia (digest: /var/lib/pacemaker/cib/cib.fBXFs6) >Aug 21 13:21:03 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:21:03 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/14, version=0.15.2) >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-lb_monitor_0 (5) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 4: probe_complete probe_complete-d-6q2lmw1 on d-6q2lmw1 - no waiting >Aug 21 13:21:03 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 4 confirmed - no wait >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_dbus_find_error: GetUnit error 'org.freedesktop.systemd1.NoSuchUnit': Unit haproxy.service is not loaded. >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: systemd_unit_by_name: Call to GetUnit failed: org.freedesktop.systemd1.NoSuchUnit >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_dbus_find_error: Reload error 'org.freedesktop.DBus.Error.AccessDenied': Rejected send message, 2 matched rules; type="method_call", sender=":1.51730" (uid=189 pid=11661 comm="/usr/libexec/pacemaker/crmd ") interface="org.freedesktop.systemd1.Manager" member="Reload" error name="(unset)" requested_reply="0" destination="org.freedesktop.systemd1" (uid=0 pid=1 comm="/usr/lib/systemd/systemd --switched-root --system ") >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation haproxy-lb_monitor_0 (call=18, rc=7, cib-update=288, confirmed=true) not running >Aug 21 13:21:04 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/15, version=0.15.3) >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-lb_monitor_0 (9) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 8: probe_complete probe_complete-d-gqynnw1 on d-gqynnw1 - no waiting >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 8 confirmed - no wait >Aug 21 13:21:04 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/288, version=0.15.4) >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-lb_monitor_0 (7) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 6: probe_complete probe_complete-d-d9ckmw1 on d-d9ckmw1 (local) - no waiting >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 6 confirmed - no wait >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 131 (Complete=6, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-20.bz2): Stopped >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:21:04 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/289, version=0.15.4) >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Stopped >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for haproxy-lb on d-6q2lmw1 >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start haproxy-lb (d-6q2lmw1) >Aug 21 13:21:04 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 132: /var/lib/pacemaker/pengine/pe-input-21.bz2 >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 132 (ref=pe_calc-dc-1408645264-226) derived from /var/lib/pacemaker/pengine/pe-input-21.bz2 >Aug 21 13:21:04 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 9: start haproxy-lb_start_0 on d-6q2lmw1 >Aug 21 13:21:06 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2162210 for uid=0 gid=0 pid=42944 id=4d053fbf-0eb9-4268-af70-9ddffe91d4b8 >Aug 21 13:21:06 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.15.4) >Aug 21 13:21:06 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:21:06 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2162210 for uid=0 gid=0 pid=42945 id=d8c1c891-669c-472b-900e-c72affa038b7 >Aug 21 13:21:06 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.15.4) >Aug 21 13:21:06 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:21:06 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/15, version=0.15.5) >Aug 21 13:21:06 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-lb_start_0 (9) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:21:06 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 10: monitor haproxy-lb_monitor_60000 on d-6q2lmw1 >Aug 21 13:21:06 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/16, version=0.15.6) >Aug 21 13:21:06 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action haproxy-lb_monitor_60000 (10) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:21:06 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 132 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-21.bz2): Complete >Aug 21 13:21:06 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 13:21:06 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:21:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2162210 for uid=0 gid=0 pid=42985 id=fec7fa70-10c7-4f16-bda5-8f780220cfcf >Aug 21 13:21:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.15.6) >Aug 21 13:21:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //cib/configuration/resources//*[@id="haproxy-lb"]/meta_attributes//nvpair[@name="target-role"]: No such device or address (rc=-6, origin=local/crm_resource/3, version=0.15.6) >Aug 21 13:21:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:21:20 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2162210 for uid=0 gid=0 pid=42990 id=510a6321-628a-45ce-a5ef-163e2d45d39c >Aug 21 13:21:20 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.15.6) >Aug 21 13:21:20 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:21:20 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2162210 for uid=0 gid=0 pid=42991 id=e8613d55-3a0c-45d0-bd2c-b167f663e406 >Aug 21 13:21:20 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.15.6) >Aug 21 13:21:20 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2162210 for uid=0 gid=0 pid=43268 id=56e0d600-646b-4c5d-aff9-36d1496b6410 >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //resources/descendant::primitive[@id="neutron-vip"]: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.15.6) >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2162210 for uid=0 gid=0 pid=43277 id=0e7050d1-9a57-497c-a913-3637bbbbdda8 >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: --- 0.15.6 >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: +++ 0.16.1 22c4c7b5e74619334c315def3616a145 >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <cib admin_epoch="0" epoch="15" num_updates="6"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="ocf" id="neutron-vip" provider="heartbeat" type="IPaddr2"> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="neutron-vip-instance_attributes"> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <nvpair id="neutron-vip-instance_attributes-ip" name="ip" value="10.63.28.216"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </instance_attributes> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="neutron-vip-start-timeout-20s" interval="0s" name="start" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="neutron-vip-stop-timeout-20s" interval="0s" name="stop" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="neutron-vip-monitor-interval-10s" interval="10s" name="monitor" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_create operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.16.1) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=1, node=, tag=diff, id=(null), magic=NA, cib=0.16.1) : Non-status change >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] >Aug 21 13:23:18 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:23:18 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/290, version=0.16.1) >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-14.raw >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.16.0 of the CIB to disk (digest: 499b5d9a5dac9dd55153675d45704a1c) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Stopped >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.AGDIn0 (digest: /var/lib/pacemaker/cib/cib.cXFYvF) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (10s) for neutron-vip on d-d9ckmw1 >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start neutron-vip (d-d9ckmw1) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 133: /var/lib/pacemaker/pengine/pe-input-22.bz2 >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 133 (ref=pe_calc-dc-1408645398-229) derived from /var/lib/pacemaker/pengine/pe-input-22.bz2 >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 10: monitor neutron-vip_monitor_0 on d-gqynnw1 >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 8: monitor neutron-vip_monitor_0 on d-d9ckmw1 (local) >Aug 21 13:23:18 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_get_rsc_info: Resource 'neutron-vip' not found (2 active resources) >Aug 21 13:23:18 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_rsc_register: Added 'neutron-vip' to the rsc list (3 active resources) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=8:133:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=neutron-vip_monitor_0 >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 6: monitor neutron-vip_monitor_0 on d-6q2lmw1 >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x216aa00 for uid=0 gid=0 pid=43279 id=7ced78eb-d356-442b-a785-a2b6b636636e >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.16.1) >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x216aa00 for uid=0 gid=0 pid=43284 id=b851bf25-c878-43a2-ae05-e7bf21b3c665 >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: log_cib_diff: cib:diff: Local-only Change: 0.17.1 >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <primitive class="ocf" id="neutron-vip" provider="heartbeat" type="IPaddr2"> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <instance_attributes id="neutron-vip-instance_attributes"> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <nvpair id="neutron-vip-instance_attributes-ip" name="ip" value="10.63.28.216"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </instance_attributes> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <operations> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="neutron-vip-start-timeout-20s" interval="0s" name="start" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="neutron-vip-stop-timeout-20s" interval="0s" name="stop" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="neutron-vip-monitor-interval-10s" interval="10s" name="monitor" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </operations> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </primitive> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <group id="neutron-group"> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="ocf" id="neutron-vip" provider="heartbeat" type="IPaddr2"> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="neutron-vip-instance_attributes"> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <nvpair id="neutron-vip-instance_attributes-ip" name="ip" value="10.63.28.216"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </instance_attributes> >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.17.1) : Non-status change >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="neutron-vip-start-timeout-20s" interval="0s" name="start" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="neutron-vip-stop-timeout-20s" interval="0s" name="stop" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="neutron-vip-monitor-interval-10s" interval="10s" name="monitor" timeout="20s"/> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </group> >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_replace operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.17.1) >Aug 21 13:23:18 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:23:18 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-15.raw >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.17.0 of the CIB to disk (digest: 6966506c830f61369de22d234a9bf2fc) >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.nJOuF1 (digest: /var/lib/pacemaker/cib/cib.0U7oUG) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation neutron-vip_monitor_0 (call=22, rc=7, cib-update=291, confirmed=true) not running >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/291, version=0.17.2) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action neutron-vip_monitor_0 (8) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 7: probe_complete probe_complete-d-d9ckmw1 on d-d9ckmw1 (local) - no waiting >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 7 confirmed - no wait >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/17, version=0.17.3) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action neutron-vip_monitor_0 (6) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 5: probe_complete probe_complete-d-6q2lmw1 on d-6q2lmw1 - no waiting >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 5 confirmed - no wait >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/16, version=0.17.4) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action neutron-vip_monitor_0 (10) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 9: probe_complete probe_complete-d-gqynnw1 on d-gqynnw1 - no waiting >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 9 confirmed - no wait >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 133 (Complete=6, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-22.bz2): Stopped >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/292, version=0.17.4) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Stopped >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (10s) for neutron-vip on d-d9ckmw1 >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start neutron-vip (d-d9ckmw1) >Aug 21 13:23:18 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 134: /var/lib/pacemaker/pengine/pe-input-23.bz2 >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 134 (ref=pe_calc-dc-1408645398-236) derived from /var/lib/pacemaker/pengine/pe-input-23.bz2 >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 16: start neutron-vip_start_0 on d-d9ckmw1 (local) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=16:134:0:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=neutron-vip_start_0 >Aug 21 13:23:18 [11658] d-d9ckmw1.hq.target.com lrmd: info: log_execute: executing - rsc:neutron-vip action:start call_id:23 >IPaddr2(neutron-vip)[43326]: 2014/08/21_13:23:18 INFO: Adding inet address 10.63.28.216/25 with broadcast address 10.63.28.255 to device bond0 >IPaddr2(neutron-vip)[43326]: 2014/08/21_13:23:18 INFO: Bringing device bond0 up >IPaddr2(neutron-vip)[43326]: 2014/08/21_13:23:18 INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /var/run/resource-agents/send_arp-10.63.28.216 bond0 10.63.28.216 auto not_used not_used >Aug 21 13:23:18 [11658] d-d9ckmw1.hq.target.com lrmd: info: log_finished: finished - rsc:neutron-vip action:start call_id:23 pid:43326 exit-code:0 exec-time:118ms queue-time:0ms >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: services_os_action_execute: Managed IPaddr2_meta-data_0 process 43396 exited with rc=0 >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation neutron-vip_start_0 (call=23, rc=0, cib-update=293, confirmed=true) ok >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/293, version=0.17.5) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action neutron-vip_start_0 (16) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 17: monitor neutron-vip_monitor_10000 on d-d9ckmw1 (local) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=17:134:0:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=neutron-vip_monitor_10000 >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation neutron-vip_monitor_10000 (call=24, rc=0, cib-update=294, confirmed=false) ok >Aug 21 13:23:18 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/294, version=0.17.6) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action neutron-vip_monitor_10000 (17) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 134 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-23.bz2): Complete >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 13:23:18 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:23:20 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x216c010 for uid=0 gid=0 pid=43447 id=6d693115-27a3-4c7f-8bb2-67e6f18741a4 >Aug 21 13:23:20 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.17.6) >Aug 21 13:23:20 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:23:20 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x216c010 for uid=0 gid=0 pid=43448 id=5f24c874-4f08-4b43-b104-5826256b95e6 >Aug 21 13:23:20 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.17.6) >Aug 21 13:23:20 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x216c010 for uid=0 gid=0 pid=44889 id=595e7eb4-758f-4278-9813-e9980663cc5e >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //resources/descendant::primitive[@id="memcached"]: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.17.6) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x216c010 for uid=0 gid=0 pid=44890 id=eabb472a-3d54-4c37-9acc-4fd5c37622dc >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: --- 0.17.6 >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: +++ 0.18.1 991d84a68cd3fbbb2af9a4721be1043b >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <cib admin_epoch="0" epoch="17" num_updates="6"/> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="systemd" id="memcached" type="memcached"> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="memcached-instance_attributes"/> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="memcached-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_create operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.18.1) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=1, node=, tag=diff, id=(null), magic=NA, cib=0.18.1) : Non-status change >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] >Aug 21 13:26:09 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:26:09 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/295, version=0.18.1) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-16.raw >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.18.0 of the CIB to disk (digest: cb0caabf7b4c2800550a381d7e9e17fa) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.c4jHU8 (digest: /var/lib/pacemaker/cib/cib.VxxlzP) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: memcached (systemd:memcached): Stopped >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for memcached on d-gqynnw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start memcached (d-gqynnw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 135: /var/lib/pacemaker/pengine/pe-input-24.bz2 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 135 (ref=pe_calc-dc-1408645569-239) derived from /var/lib/pacemaker/pengine/pe-input-24.bz2 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 11: monitor memcached_monitor_0 on d-gqynnw1 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 9: monitor memcached_monitor_0 on d-d9ckmw1 (local) >Aug 21 13:26:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_get_rsc_info: Resource 'memcached' not found (3 active resources) >Aug 21 13:26:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_rsc_register: Added 'memcached' to the rsc list (4 active resources) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=9:135:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=memcached_monitor_0 >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21f11b0 for uid=0 gid=0 pid=44892 id=9cdd95a8-4f93-415f-9730-4641f58ddb8c >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 7: monitor memcached_monitor_0 on d-6q2lmw1 >Aug 21 13:26:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.18.1) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation memcached_monitor_0 (call=28, rc=0, cib-update=296, confirmed=true) ok >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/296, version=0.18.2) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: warning: status_from_rc: Action 9 (memcached_monitor_0) on d-d9ckmw1 failed (target: 7 vs. rc: 0): Error >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: match_graph_event:313 - Triggered transition abort (complete=0, node=d-d9ckmw1, tag=lrm_rsc_op, id=memcached_last_failure_0, magic=0:0;9:135:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f, cib=0.18.2) : Event failed >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action memcached_monitor_0 (9) confirmed on d-d9ckmw1 (rc=4) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: process_graph_event: Detected action (135.9) memcached_monitor_0.28=ok: failed >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 8: probe_complete probe_complete-d-d9ckmw1 on d-d9ckmw1 (local) - no waiting >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 8 confirmed - no wait >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2190a70 for uid=0 gid=0 pid=44893 id=1fdb7a87-0bac-4152-ba9e-10824bbb00b4 >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //clone//primitive[@id='memcached']: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.18.2) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2190a70 for uid=0 gid=0 pid=44894 id=cab97b7d-cd39-4691-8b01-7b785a94f140 >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //clone//group[@id='memcached']: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.18.2) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2190a70 for uid=0 gid=0 pid=44895 id=a4e4dbaa-566e-41a2-96e7-3258eb552db0 >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //master//primitive[@id='memcached']: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.18.2) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2190a70 for uid=0 gid=0 pid=44896 id=e4834003-dfb3-420d-8727-2ede40d2f33a >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: --- 0.18.2 >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: +++ 0.19.1 ffdef72904985572b7647482573f7689 >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <primitive class="systemd" id="memcached" type="memcached"> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <instance_attributes id="memcached-instance_attributes"/> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <operations> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="memcached-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </operations> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </primitive> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <clone id="memcached-clone"> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="systemd" id="memcached" type="memcached"> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="memcached-instance_attributes"/> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.19.1) : Non-status change >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="memcached-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <meta_attributes id="memcached-clone-meta"/> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </clone> >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_replace operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.19.1) >Aug 21 13:26:09 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:26:09 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-17.raw >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.19.0 of the CIB to disk (digest: a70c065ee2835c52ecfc7774b99d3dd4) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.8K0lLc (digest: /var/lib/pacemaker/cib/cib.XOheCT) >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/17, version=0.19.2) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action memcached_monitor_0 (11) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 10: probe_complete probe_complete-d-gqynnw1 on d-gqynnw1 - no waiting >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 10 confirmed - no wait >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/18, version=0.19.3) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action memcached_monitor_0 (7) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 6: probe_complete probe_complete-d-6q2lmw1 on d-6q2lmw1 - no waiting >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 6 confirmed - no wait >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 135 (Complete=6, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-24.bz2): Stopped >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/297, version=0.19.3) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-d9ckmw1 ] >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Stopped: [ d-6q2lmw1 d-gqynnw1 ] >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for memcached:0 on d-d9ckmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for memcached:1 on d-gqynnw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for memcached:2 on d-6q2lmw1 >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start memcached:1 (d-gqynnw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start memcached:2 (d-6q2lmw1) >Aug 21 13:26:09 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 136: /var/lib/pacemaker/pengine/pe-input-25.bz2 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 136 (ref=pe_calc-dc-1408645569-246) derived from /var/lib/pacemaker/pengine/pe-input-25.bz2 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 25: monitor memcached_monitor_60000 on d-d9ckmw1 (local) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=25:136:0:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=memcached_monitor_60000 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 26: start memcached_start_0 on d-gqynnw1 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 28: start memcached:2_start_0 on d-6q2lmw1 >Aug 21 13:26:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation memcached_monitor_60000 (call=29, rc=0, cib-update=298, confirmed=false) ok >Aug 21 13:26:09 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/298, version=0.19.4) >Aug 21 13:26:09 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action memcached_monitor_60000 (25) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/18, version=0.19.5) >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action memcached_start_0 (26) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 27: monitor memcached_monitor_60000 on d-gqynnw1 >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/19, version=0.19.6) >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action memcached_start_0 (28) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 29: monitor memcached:2_monitor_60000 on d-6q2lmw1 >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/19, version=0.19.7) >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action memcached_monitor_60000 (27) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/20, version=0.19.8) >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action memcached_monitor_60000 (29) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 136 (Complete=7, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-25.bz2): Complete >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 13:26:11 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21916f0 for uid=0 gid=0 pid=44948 id=cdc972af-5e1a-428f-b3cd-25f262e6dd25 >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.19.8) >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21916f0 for uid=0 gid=0 pid=44949 id=49092c38-63a9-4c8b-b79e-4d25ec4b6906 >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.19.8) >Aug 21 13:26:11 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:27:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:28:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:29:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:30:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:31:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:32:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:33:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:33:50 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21916f0 for uid=0 gid=0 pid=48484 id=25fdd5aa-910c-403b-8864-ea370b3b48bd >Aug 21 13:33:50 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.19.8) >Aug 21 13:33:50 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:33:50 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21916f0 for uid=0 gid=0 pid=48485 id=75fba84b-c5c7-4eff-bba9-e2536d494b5d >Aug 21 13:33:50 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.19.8) >Aug 21 13:33:50 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21916f0 for uid=0 gid=0 pid=48758 id=07f70764-bbfa-4682-840f-b9ffc09508d3 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //resources/descendant::primitive[@id="rabbitmq"]: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.19.8) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x21916f0 for uid=0 gid=0 pid=48759 id=0e4f7dfa-76d9-43ac-8202-516c4f08ad45 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: --- 0.19.8 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: +++ 0.20.1 44f9cb50fd6e33034bb11873ee6ceb59 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <cib admin_epoch="0" epoch="19" num_updates="8"/> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="systemd" id="rabbitmq" type="rabbitmq-server"> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="rabbitmq-instance_attributes"/> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="rabbitmq-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_create operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.20.1) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=1, node=, tag=diff, id=(null), magic=NA, cib=0.20.1) : Non-status change >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] >Aug 21 13:34:31 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:34:31 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/299, version=0.20.1) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-18.raw >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.20.0 of the CIB to disk (digest: 09393e4c9ec096b017af88eb97954ddc) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.pKCqpV (digest: /var/lib/pacemaker/cib/cib.DnaFei) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: rabbitmq (systemd:rabbitmq-server): Stopped >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for rabbitmq on d-gqynnw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start rabbitmq (d-gqynnw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 137: /var/lib/pacemaker/pengine/pe-input-26.bz2 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 137 (ref=pe_calc-dc-1408646071-252) derived from /var/lib/pacemaker/pengine/pe-input-26.bz2 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 14: monitor rabbitmq_monitor_0 on d-gqynnw1 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 12: monitor rabbitmq_monitor_0 on d-d9ckmw1 (local) >Aug 21 13:34:31 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_get_rsc_info: Resource 'rabbitmq' not found (4 active resources) >Aug 21 13:34:31 [11658] d-d9ckmw1.hq.target.com lrmd: info: process_lrmd_rsc_register: Added 'rabbitmq' to the rsc list (5 active resources) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=12:137:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=rabbitmq_monitor_0 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=48761 id=95e57fd3-485d-46d8-a321-7b1d54554bc8 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 10: monitor rabbitmq_monitor_0 on d-6q2lmw1 >Aug 21 13:34:31 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.20.1) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation rabbitmq_monitor_0 (call=33, rc=0, cib-update=300, confirmed=true) ok >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/300, version=0.20.2) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: warning: status_from_rc: Action 12 (rabbitmq_monitor_0) on d-d9ckmw1 failed (target: 7 vs. rc: 0): Error >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: match_graph_event:313 - Triggered transition abort (complete=0, node=d-d9ckmw1, tag=lrm_rsc_op, id=rabbitmq_last_failure_0, magic=0:0;12:137:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f, cib=0.20.2) : Event failed >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_monitor_0 (12) confirmed on d-d9ckmw1 (rc=4) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: process_graph_event: Detected action (137.12) rabbitmq_monitor_0.33=ok: failed >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 11: probe_complete probe_complete-d-d9ckmw1 on d-d9ckmw1 (local) - no waiting >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 11 confirmed - no wait >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/20, version=0.20.3) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: warning: status_from_rc: Action 14 (rabbitmq_monitor_0) on d-gqynnw1 failed (target: 7 vs. rc: 0): Error >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: match_graph_event:313 - Triggered transition abort (complete=0, node=d-gqynnw1, tag=lrm_rsc_op, id=rabbitmq_last_failure_0, magic=0:0;14:137:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f, cib=0.20.3) : Event failed >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_monitor_0 (14) confirmed on d-gqynnw1 (rc=4) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: process_graph_event: Detected action (137.14) rabbitmq_monitor_0.28=ok: failed >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 13: probe_complete probe_complete-d-gqynnw1 on d-gqynnw1 - no waiting >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 13 confirmed - no wait >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/21, version=0.20.4) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: warning: status_from_rc: Action 10 (rabbitmq_monitor_0) on d-6q2lmw1 failed (target: 7 vs. rc: 0): Error >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: match_graph_event:313 - Triggered transition abort (complete=0, node=d-6q2lmw1, tag=lrm_rsc_op, id=rabbitmq_last_failure_0, magic=0:0;10:137:7:8b975297-15a8-4cd3-86bd-7b5fdc76012f, cib=0.20.4) : Event failed >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_monitor_0 (10) confirmed on d-6q2lmw1 (rc=4) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: process_graph_event: Detected action (137.10) rabbitmq_monitor_0.27=ok: failed >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 9: probe_complete probe_complete-d-6q2lmw1 on d-6q2lmw1 - no waiting >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: te_rsc_command: Action 9 confirmed - no wait >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 137 (Complete=6, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-26.bz2): Stopped >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/301, version=0.20.4) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq active on d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq active on d-gqynnw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq active on d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: rabbitmq (systemd:rabbitmq-server): Started >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: 1 : d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: 2 : d-gqynnw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: 3 : d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: error: native_create_actions: Resource rabbitmq (systemd::rabbitmq-server) is active on 3 nodes attempting recovery >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: warning: native_create_actions: See http://clusterlabs.org/wiki/FAQ#Resource_is_Too_Active for more information. >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for rabbitmq on d-gqynnw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Move rabbitmq (Started d-d9ckmw1 -> d-gqynnw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: error: process_pe_message: Calculated Transition 138: /var/lib/pacemaker/pengine/pe-error-0.bz2 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 138 (ref=pe_calc-dc-1408646071-259) derived from /var/lib/pacemaker/pengine/pe-error-0.bz2 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 38: stop rabbitmq_stop_0 on d-6q2lmw1 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 37: stop rabbitmq_stop_0 on d-gqynnw1 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 36: stop rabbitmq_stop_0 on d-d9ckmw1 (local) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=36:138:0:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=rabbitmq_stop_0 >Aug 21 13:34:31 [11658] d-d9ckmw1.hq.target.com lrmd: info: log_execute: executing - rsc:rabbitmq action:stop call_id:34 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=48762 id=24f2f989-7821-4e48-bac8-a503596ef95b >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //clone//primitive[@id='rabbitmq']: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.20.4) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=48763 id=2d2b386b-e770-4b4e-8b66-b81b71e8f87a >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //clone//group[@id='rabbitmq']: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.20.4) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=48773 id=3a54dc72-043a-4f7c-90ed-825d3d844e08 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section //master//primitive[@id='rabbitmq']: No such device or address (rc=-6, origin=local/cibadmin/2, version=0.20.4) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2160c90 for uid=0 gid=0 pid=48774 id=32e4607c-3387-4ed8-a034-7f3aafdf3139 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: --- 0.20.4 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: Diff: +++ 0.21.1 b99d29dda2951ddd788610f73c1ce900 >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <primitive class="systemd" id="rabbitmq" type="rabbitmq-server"> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <instance_attributes id="rabbitmq-instance_attributes"/> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <operations> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- <op id="rabbitmq-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </operations> >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.21.1) : Non-status change >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: -- </primitive> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <clone id="rabbitmq-clone"> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <primitive class="systemd" id="rabbitmq" type="rabbitmq-server"> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <instance_attributes id="rabbitmq-instance_attributes"/> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <operations> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <op id="rabbitmq-monitor-interval-60s" interval="60s" name="monitor"/> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </operations> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </primitive> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ <meta_attributes id="rabbitmq-clone-meta"/> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: notice: cib:diff: ++ </clone> >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_replace operation for section resources: OK (rc=0, origin=local/cibadmin/2, version=0.21.1) >Aug 21 13:34:31 [11657] d-d9ckmw1.hq.target.com stonith-ng: info: update_cib_stonith_devices: Updating device list from the cib: new resource >Aug 21 13:34:31 [11657] d-d9ckmw1.hq.target.com stonith-ng: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-19.raw >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: write_cib_contents: Wrote version 0.21.0 of the CIB to disk (digest: 8d6b46698a93b9337e5bc1157b8d9d72) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.gF79E2 (digest: /var/lib/pacemaker/cib/cib.NHxEHp) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/21, version=0.21.2) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_stop_0 (37) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:34:31 [11658] d-d9ckmw1.hq.target.com lrmd: info: systemd_async_dispatch: Call to stop passed: /org/freedesktop/systemd1/job/300286 >Aug 21 13:34:31 [11658] d-d9ckmw1.hq.target.com lrmd: info: log_finished: finished - rsc:rabbitmq action:stop call_id:34 exit-code:0 exec-time:85ms queue-time:0ms >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/22, version=0.21.3) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation rabbitmq_stop_0 (call=34, rc=0, cib-update=302, confirmed=true) ok >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_stop_0 (38) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/302, version=0.21.4) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_stop_0 (36) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 138 (Complete=3, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-error-0.bz2): Stopped >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:34:31 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/303, version=0.21.4) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-gqynnw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Stopped: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for rabbitmq:0 on d-gqynnw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for rabbitmq:1 on d-d9ckmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: RecurringOp: Start recurring monitor (60s) for rabbitmq:2 on d-6q2lmw1 >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start rabbitmq:0 (d-gqynnw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start rabbitmq:1 (d-d9ckmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: LogActions: Start rabbitmq:2 (d-6q2lmw1) >Aug 21 13:34:31 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 139: /var/lib/pacemaker/pengine/pe-input-27.bz2 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 139 (ref=pe_calc-dc-1408646071-263) derived from /var/lib/pacemaker/pengine/pe-input-27.bz2 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 36: start rabbitmq_start_0 on d-gqynnw1 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 38: start rabbitmq:1_start_0 on d-d9ckmw1 (local) >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=38:139:0:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=rabbitmq_start_0 >Aug 21 13:34:31 [11658] d-d9ckmw1.hq.target.com lrmd: info: log_execute: executing - rsc:rabbitmq action:start call_id:35 >Aug 21 13:34:31 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 40: start rabbitmq:2_start_0 on d-6q2lmw1 >Aug 21 13:34:31 [11658] d-d9ckmw1.hq.target.com lrmd: info: systemd_async_dispatch: Call to start passed: /org/freedesktop/systemd1/job/300287 >Aug 21 13:34:33 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2185c10 for uid=0 gid=0 pid=49119 id=a8639c1c-f279-43bd-bacb-0498bef56de5 >Aug 21 13:34:33 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.21.4) >Aug 21 13:34:33 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:33 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2185c10 for uid=0 gid=0 pid=49120 id=090247a0-b737-4356-96e6-b6281b93806d >Aug 21 13:34:33 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:34:33 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.21.4) >Aug 21 13:34:33 [11658] d-d9ckmw1.hq.target.com lrmd: notice: action_complete: rabbitmq monitor failed (rc=196): re-scheduling (time_sum=2443ms, start_delay=2000ms, timeout=17557ms) >Aug 21 13:34:33 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:34:35 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation rabbitmq_start_0 (call=35, rc=0, cib-update=304, confirmed=true) ok >Aug 21 13:34:35 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/304, version=0.21.5) >Aug 21 13:34:35 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_start_0 (38) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:34:35 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 39: monitor rabbitmq:1_monitor_60000 on d-d9ckmw1 (local) >Aug 21 13:34:35 [11661] d-d9ckmw1.hq.target.com crmd: info: do_lrm_rsc_op: Performing key=39:139:0:8b975297-15a8-4cd3-86bd-7b5fdc76012f op=rabbitmq_monitor_60000 >Aug 21 13:34:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:34:35 [11661] d-d9ckmw1.hq.target.com crmd: notice: process_lrm_event: LRM operation rabbitmq_monitor_60000 (call=36, rc=0, cib-update=305, confirmed=false) ok >Aug 21 13:34:35 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/305, version=0.21.6) >Aug 21 13:34:35 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_monitor_60000 (39) confirmed on d-d9ckmw1 (rc=0) >Aug 21 13:34:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/22, version=0.21.7) >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_start_0 (36) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 37: monitor rabbitmq_monitor_60000 on d-gqynnw1 >Aug 21 13:34:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-gqynnw1/crmd/23, version=0.21.8) >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_monitor_60000 (37) confirmed on d-gqynnw1 (rc=0) >Aug 21 13:34:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/23, version=0.21.9) >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_start_0 (40) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: te_rsc_command: Initiating action 41: monitor rabbitmq:2_monitor_60000 on d-6q2lmw1 >Aug 21 13:34:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=d-6q2lmw1/crmd/24, version=0.21.10) >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: match_graph_event: Action rabbitmq_monitor_60000 (41) confirmed on d-6q2lmw1 (rc=0) >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 139 (Complete=8, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-27.bz2): Complete >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 13:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2186030 for uid=0 gid=0 pid=49145 id=bb3376e1-99e0-4875-93fd-4272d14806ee >Aug 21 13:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.21.10) >Aug 21 13:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_new: Connecting 0x2186030 for uid=0 gid=0 pid=49146 id=35e5b411-4dc2-440c-a74e-c86df23192bf >Aug 21 13:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.21.10) >Aug 21 13:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: crm_client_destroy: Destroying 0 events >Aug 21 13:35:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:35:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:36:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:36:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:37:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:37:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:38:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:38:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:39:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:39:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:40:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:40:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:41:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:41:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:42:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:42:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:43:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:43:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:44:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:44:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:45:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:45:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:46:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:46:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:47:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:47:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:48:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:48:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:49:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:49:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 13:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 13:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 13:49:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/306, version=0.21.10) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 13:49:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 140: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 13:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 13:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 140 (ref=pe_calc-dc-1408646977-270) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 13:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 140 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 13:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 13:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 13:50:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:50:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:51:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:51:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:52:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:52:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:53:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:53:35 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:54:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:54:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:55:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:55:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:56:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:56:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:57:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:57:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:58:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:58:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:59:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 13:59:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:00:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:00:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:01:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:01:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:02:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:02:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:03:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:03:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:04:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:04:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 14:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 14:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 14:04:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/307, version=0.21.10) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 14:04:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 141: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 14:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 14:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 141 (ref=pe_calc-dc-1408647877-271) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 14:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 141 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 14:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 14:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 14:05:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:05:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:06:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:06:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:07:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:07:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:08:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:08:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:09:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:09:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:10:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:10:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:11:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:11:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:12:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:12:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:13:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:13:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:14:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:14:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:15:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:15:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:16:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:16:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:17:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:17:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:18:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:18:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:19:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:19:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 14:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 14:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 14:19:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/308, version=0.21.10) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 14:19:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 142: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 14:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 14:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 142 (ref=pe_calc-dc-1408648777-272) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 14:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 142 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 14:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 14:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 14:20:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:20:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:21:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:21:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:22:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:22:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:23:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:23:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:24:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:24:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:25:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:25:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:26:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:26:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:27:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:27:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:28:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:28:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:29:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:29:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:30:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:30:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:31:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:31:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:32:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:32:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:33:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:33:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:34:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:34:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 14:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 14:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 14:34:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/309, version=0.21.10) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 14:34:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 143: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 14:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 14:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 143 (ref=pe_calc-dc-1408649677-273) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 14:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 143 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 14:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 14:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 14:35:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:35:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:36:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:36:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:37:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:37:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:38:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:38:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:39:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:39:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:40:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:40:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:41:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:41:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:42:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:42:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:43:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:43:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:44:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:44:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:45:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:45:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:46:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:46:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:47:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:47:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:48:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:48:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:49:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:49:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 14:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 14:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 14:49:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/310, version=0.21.10) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 14:49:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 144: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 14:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 14:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 144 (ref=pe_calc-dc-1408650577-274) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 14:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 144 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 14:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 14:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 14:50:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:50:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:51:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:51:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:52:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:52:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:53:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:53:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:54:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:54:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:55:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:55:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:56:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:56:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:57:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:57:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:58:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:58:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:59:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 14:59:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:00:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:00:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:01:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:01:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:02:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:02:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:03:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:03:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:04:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:04:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 15:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 15:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 15:04:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/311, version=0.21.10) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 15:04:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 145: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 15:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 15:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 145 (ref=pe_calc-dc-1408651477-275) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 15:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 145 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 15:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 15:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 15:05:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:05:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:06:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:06:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:07:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:07:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:08:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:08:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:09:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:09:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:10:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:10:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:11:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:11:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:12:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:12:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:13:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:13:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:14:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:14:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:15:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:15:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:16:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:16:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:17:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:17:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:18:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:18:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:19:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:19:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 15:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 15:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 15:19:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/312, version=0.21.10) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 15:19:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 146: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 15:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 15:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 146 (ref=pe_calc-dc-1408652377-276) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 15:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 146 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 15:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 15:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 15:20:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:20:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:21:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:21:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:22:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:22:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:23:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:23:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:24:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:24:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:25:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:25:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:26:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:26:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:27:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:27:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:28:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:28:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:29:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:29:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:30:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:30:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:31:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:31:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:32:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:32:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:33:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:33:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:34:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:34:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 15:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 15:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 15:34:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/313, version=0.21.10) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 15:34:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 147: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 15:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 15:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 147 (ref=pe_calc-dc-1408653277-277) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 15:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 147 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 15:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 15:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 15:35:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:35:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:36:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:36:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:37:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:37:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:38:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:38:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:39:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:39:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:40:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:40:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:41:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:41:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:42:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:42:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:43:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:43:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:44:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:44:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:45:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:45:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:46:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:46:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:47:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:47:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:48:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:48:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:49:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:49:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 15:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 15:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 15:49:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/314, version=0.21.10) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 15:49:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 148: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 15:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 15:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 148 (ref=pe_calc-dc-1408654177-278) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 15:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 148 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 15:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 15:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 15:50:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:50:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:51:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:51:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:52:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:52:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:53:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:53:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:54:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:54:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:55:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:55:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:56:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:56:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:57:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:57:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:58:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:58:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:59:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 15:59:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:00:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:00:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:01:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:01:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:02:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:02:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:03:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:03:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:04:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:04:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 16:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 16:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 16:04:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/315, version=0.21.10) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 16:04:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 149: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 16:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 16:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 149 (ref=pe_calc-dc-1408655077-279) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 16:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 149 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 16:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 16:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 16:05:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:05:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:06:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:06:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:07:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:07:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:08:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:08:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:09:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:09:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:10:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:10:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:11:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:11:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:12:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:12:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:13:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:13:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:14:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:14:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:15:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:15:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:16:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:16:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:17:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:17:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:18:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:18:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:19:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:19:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 16:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 16:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 16:19:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/316, version=0.21.10) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 16:19:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 150: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 16:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 16:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 150 (ref=pe_calc-dc-1408655977-280) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 16:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 150 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 16:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 16:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 16:20:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:20:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:21:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:21:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:22:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:22:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:23:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:23:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:24:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:24:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:25:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:25:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:26:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:26:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:27:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:27:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:28:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:28:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:29:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:29:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:30:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:30:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:31:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:31:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:32:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:32:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:33:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:33:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:34:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:34:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 16:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 16:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 16:34:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/317, version=0.21.10) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 16:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 16:34:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 151: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 16:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 151 (ref=pe_calc-dc-1408656877-281) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 16:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 151 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 16:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 16:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 16:35:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:35:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:36:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:36:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:37:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:37:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:38:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:38:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:39:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:39:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:40:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:40:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:41:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:41:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:42:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:42:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:43:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:43:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:44:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:44:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:45:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:45:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:46:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:46:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:47:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:47:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:48:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:48:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:49:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:49:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 16:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 16:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 16:49:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/318, version=0.21.10) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 16:49:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 152: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 16:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 16:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 152 (ref=pe_calc-dc-1408657777-282) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 16:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 152 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 16:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 16:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 16:50:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:50:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:51:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:51:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:52:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:52:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:53:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:53:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:54:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:54:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:55:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:55:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:56:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:56:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:57:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:57:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:58:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:58:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:59:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 16:59:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:00:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:00:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:01:09 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:01:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:02:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:02:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:03:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:03:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:04:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:04:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 17:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 17:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 17:04:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/319, version=0.21.10) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 17:04:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 153: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 17:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 17:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 153 (ref=pe_calc-dc-1408658677-283) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 17:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 153 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 17:04:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 17:04:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 17:05:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:05:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:06:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:06:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:07:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:07:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:08:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:08:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:09:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:09:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:10:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:10:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:11:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:11:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:12:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:12:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:13:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:13:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:14:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:14:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:15:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:15:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:16:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:16:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:17:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:17:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:18:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:18:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:19:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:19:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 17:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 17:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 17:19:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/320, version=0.21.10) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 17:19:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 154: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 17:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 17:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 154 (ref=pe_calc-dc-1408659577-284) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 17:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 154 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 17:19:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 17:19:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 17:20:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:20:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:21:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:21:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:22:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:22:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:23:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:23:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:24:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:24:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:25:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:25:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:26:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:26:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:27:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:27:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:28:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:28:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:29:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:29:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:30:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:30:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:31:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:31:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:32:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:32:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:33:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:33:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:34:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:34:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 17:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 17:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 17:34:37 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/321, version=0.21.10) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 17:34:37 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 155: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 17:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 17:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 155 (ref=pe_calc-dc-1408660477-285) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 17:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 155 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 17:34:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 17:34:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 17:35:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:35:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:36:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:36:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:37:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:37:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:38:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:38:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:39:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:39:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:40:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:40:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:41:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:41:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:42:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:42:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:43:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:43:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:44:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:44:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:45:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:45:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:46:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:46:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:47:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:47:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:48:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:48:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:49:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:49:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 17:49:37 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 17:49:37 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 17:49:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/322, version=0.21.10) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 17:49:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 156: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 17:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 17:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 156 (ref=pe_calc-dc-1408661378-286) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 17:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 156 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 17:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 17:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 17:50:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:50:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:51:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:51:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:52:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:52:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:53:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:53:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:54:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:54:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:55:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:55:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:56:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:56:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:57:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:57:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:58:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:58:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:59:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 17:59:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:00:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:00:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:01:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:01:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:02:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:02:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:03:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:03:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:04:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:04:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 18:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 18:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 18:04:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/323, version=0.21.10) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 18:04:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 157: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 18:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 18:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 157 (ref=pe_calc-dc-1408662278-287) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 18:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 157 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 18:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 18:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 18:05:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:05:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:06:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:06:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:07:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:07:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:08:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:08:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:09:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:09:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:10:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:10:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:11:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:11:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:12:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:12:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:13:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:13:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:14:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:14:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:15:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:15:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:16:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:16:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:17:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:17:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:18:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:18:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:19:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:19:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 18:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 18:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 18:19:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/324, version=0.21.10) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 18:19:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 158: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 18:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 18:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 158 (ref=pe_calc-dc-1408663178-288) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 18:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 158 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 18:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 18:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 18:20:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:20:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:21:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:21:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:22:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:22:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:23:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:23:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:24:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:24:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:25:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:25:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:26:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:26:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:27:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:27:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:28:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:28:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:29:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:29:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:30:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:30:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:31:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:31:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:32:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:32:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:33:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:33:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:34:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:34:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 18:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 18:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 18:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/325, version=0.21.10) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 18:34:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 159: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 18:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 18:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 159 (ref=pe_calc-dc-1408664078-289) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 18:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 159 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 18:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 18:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 18:35:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:35:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:36:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:36:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:37:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:37:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:38:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:38:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:39:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:39:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:40:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:40:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:41:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:41:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:42:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:42:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:43:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:43:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:44:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:44:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:45:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:45:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:46:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:46:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:47:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:47:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:48:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:48:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:49:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:49:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 18:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 18:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 18:49:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/326, version=0.21.10) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 18:49:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 160: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 18:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 18:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 160 (ref=pe_calc-dc-1408664978-290) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 18:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 160 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 18:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 18:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 18:50:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:50:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:51:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:51:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:52:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:52:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:53:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:53:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:54:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:54:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:55:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:55:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:56:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:56:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:57:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:57:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:58:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:58:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:59:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 18:59:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:00:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:00:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:01:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:01:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:02:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:02:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:03:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:03:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:04:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:04:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 19:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 19:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 19:04:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/327, version=0.21.10) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 19:04:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 161: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 19:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 19:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 161 (ref=pe_calc-dc-1408665878-291) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 19:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 161 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 19:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 19:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 19:05:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:05:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:06:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:06:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:07:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:07:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:08:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:08:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:09:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:09:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:10:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:10:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:11:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:11:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:12:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:12:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:13:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:13:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:14:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:14:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:15:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:15:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:16:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:16:36 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:17:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:17:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:18:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:18:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:19:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:19:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 19:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 19:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 19:19:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/328, version=0.21.10) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 19:19:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 162: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 19:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 19:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 162 (ref=pe_calc-dc-1408666778-292) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 19:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 162 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 19:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 19:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 19:20:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:20:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:21:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:21:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:22:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:22:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:23:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:23:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:24:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:24:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:25:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:25:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:26:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:26:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:27:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:27:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:28:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:28:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:29:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:29:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:30:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:30:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:31:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:31:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:32:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:32:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:33:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:33:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:34:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:34:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 19:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 19:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 19:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/329, version=0.21.10) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 19:34:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 163: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 19:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 19:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 163 (ref=pe_calc-dc-1408667678-293) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 19:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 163 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 19:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 19:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 19:35:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:35:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:36:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:36:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:37:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:37:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:38:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:38:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:39:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:39:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:40:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:40:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:41:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:41:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:42:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:42:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:43:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:43:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:44:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:44:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:45:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:45:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:46:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:46:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:47:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:47:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:48:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:48:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:49:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:49:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 19:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 19:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 19:49:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/330, version=0.21.10) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 19:49:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 164: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 19:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 19:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 164 (ref=pe_calc-dc-1408668578-294) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 19:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 164 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 19:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 19:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 19:50:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:50:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:51:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:51:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:52:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:52:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:53:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:53:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:54:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:54:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:55:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:55:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:56:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:56:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:57:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:57:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:58:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:58:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:59:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 19:59:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:00:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:00:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:01:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:01:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:02:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:02:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:03:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:03:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:04:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:04:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 20:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 20:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 20:04:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/331, version=0.21.10) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 20:04:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 165: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 20:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 20:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 165 (ref=pe_calc-dc-1408669478-295) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 20:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 165 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 20:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 20:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 20:05:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:05:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:06:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:06:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:07:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:07:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:08:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:08:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:09:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:09:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:10:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:10:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:11:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:11:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:12:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:12:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:13:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:13:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:14:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:14:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:15:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:15:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:16:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:16:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:17:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:17:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:18:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:18:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:19:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:19:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 20:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 20:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 20:19:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/332, version=0.21.10) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 20:19:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 166: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 20:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 20:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 166 (ref=pe_calc-dc-1408670378-296) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 20:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 166 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 20:19:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 20:19:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 20:20:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:20:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:21:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:21:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:22:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:22:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:23:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:23:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:24:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:24:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:25:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:25:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:26:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:26:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:27:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:27:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:28:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:28:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:29:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:29:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:30:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:30:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:31:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:31:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:32:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:32:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:33:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:33:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:34:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:34:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 20:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 20:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 20:34:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/333, version=0.21.10) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 20:34:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 167: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 20:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 20:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 167 (ref=pe_calc-dc-1408671278-297) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 20:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 167 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 20:34:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 20:34:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 20:35:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:35:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:36:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:36:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:37:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:37:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:38:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:38:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:39:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:39:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:40:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:40:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:41:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:41:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:42:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:42:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:43:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:43:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:44:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:44:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:45:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:45:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:46:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:46:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:47:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:47:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:48:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:48:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:49:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:49:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 20:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 20:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 20:49:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/334, version=0.21.10) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:0 (Started d-d9ckmw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:1 (Started d-gqynnw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave rabbitmq:2 (Started d-6q2lmw1) >Aug 21 20:49:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: process_pe_message: Calculated Transition 168: /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 20:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] >Aug 21 20:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_te_invoke: Processing graph 168 (ref=pe_calc-dc-1408672178-298) derived from /var/lib/pacemaker/pengine/pe-input-28.bz2 >Aug 21 20:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: run_graph: Transition 168 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete >Aug 21 20:49:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE >Aug 21 20:49:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] >Aug 21 20:50:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:50:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:51:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:51:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:52:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:52:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:53:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:53:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:54:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:54:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:55:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:55:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:56:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:56:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:57:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:57:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:58:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:58:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:59:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 20:59:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:00:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:00:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:01:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:01:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:02:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:02:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:03:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:03:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:04:10 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:04:37 [11658] d-d9ckmw1.hq.target.com lrmd: info: pcmk_dbus_get_property: Calling: GetAll on org.freedesktop.systemd1 >Aug 21 21:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (900000ms) >Aug 21 21:04:38 [11661] d-d9ckmw1.hq.target.com crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] >Aug 21 21:04:38 [11661] d-d9ckmw1.hq.target.com crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED >Aug 21 21:04:38 [11656] d-d9ckmw1.hq.target.com cib: info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/335, version=0.21.10) >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: process_pe_message: Input has not changed since last time, not saving to disk >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: notice: unpack_config: On loss of CCM Quorum: Ignore >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-d9ckmw1 is online >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-gqynnw1 is online >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: determine_online_status: Node d-6q2lmw1 is online >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource memcached:0 active on d-d9ckmw1 >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:0 active on d-d9ckmw1 >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:1 active on d-gqynnw1 >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: unpack_rsc_op: Operation monitor found resource rabbitmq:2 active on d-6q2lmw1 >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: haproxy-group >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-vip (ocf::heartbeat:IPaddr2): Started d-6q2lmw1 >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: haproxy-lb (systemd:haproxy): Started d-6q2lmw1 >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: group_print: Resource Group: neutron-group >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: native_print: neutron-vip (ocf::heartbeat:IPaddr2): Started d-d9ckmw1 >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: memcached-clone [memcached] >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: clone_print: Clone Set: rabbitmq-clone [rabbitmq] >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: short_print: Started: [ d-6q2lmw1 d-d9ckmw1 d-gqynnw1 ] >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-vip (Started d-6q2lmw1) >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave haproxy-lb (Started d-6q2lmw1) >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave neutron-vip (Started d-d9ckmw1) >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:0 (Started d-d9ckmw1) >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:1 (Started d-gqynnw1) >Aug 21 21:04:38 [11660] d-d9ckmw1.hq.target.com pengine: info: LogActions: Leave memcached:2 (Started d-6q2lmw1)
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1139701
: 935701 |
939370
|
940204